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CnI ; Abstract 

We extend our previous study of quaternionic analysis based on representation theory 
to the case of split quaternions Hr. The special role of the unit sphere in the classical 
quaternions 11 - identified with the group SU(2) - is now played by the group <SX(2,R) 
realized by the unit quaternions in Hr. As in the previous work, we use an analogue of 
,— ,, the Cay ley transform to relate the analysis on SL(2,M.) to the analysis on the imaginary 

f-H ' Lobachevski space SL(2, C)/SL(2, R) identified with the one-sheeted hyperboloid in the 

Minkowski space M. We study the counterparts of Cauchy-Fueter and Poisson formulas on 
Hr and M and show that they solve the problem of separation of the discrete and continuous 
, series. The continuous series component on Hr gives rise to the minimal representation of 

the conformal group SL(4, R), while the discrete series on M provides its if-types realized in 
a natural polynomial basis. We also obtain a surprising formula for the Plancherel measure 
of SL(2,R) in terms of the Poisson-type integral on the split quaternions Hr. Finally, 
, we show that the massless singular functions of four-dimensional quantum field theory are 

■ nothing but the kernels of projectors onto the discrete and continuous series on the imaginary 

! Lobachevski space SL(2, C) /SL(2, R). Our results once again reveal the central role of the 

Minkowski space in quaternionic and split quaternionic analysis as well as a deep connection 
between split quaternionic analysis and the four-dimensional quantum field theory. 

Keywords: Harmonic analysis on SL(2,M) and SL(2,C)/SL(2, R), minimal representation of 
SO(3,3), Cauchy-Fueter formula, split quaternions, Minkowski space, imaginary Lobachevski 
y—i . space, conformal group, Cayley transform. 

> : 

^ ■ 1 Introduction 

c3 ■ 

Six years after William Rowan Hamilton's fundamental discovery of quaternions, in 1849 James 
Cockle introduced a related algebra of "coquaternions", which in modern language is called the 
algebra of split quaternions Hr. As an algebra, Hr is isomorphic to the real 2x2 matrices 
and has signature (2, 2) with respect to the determinant viewed as a quadratic form. Unlike 
Hamilton's quaternions, not every non-zero element in Hr is invertible. However, there are 
strong parallels between the geometry and analysis on the two algebras. 

In our previous paper |FL1] we began studying analysis on the algebra of quaternions H 
from the point of view of representation theory of the quaternionic conformal group £X(2,H). 
It is well known that the spaces of harmonic, left- and right-regular functions admit natural 
actions of <SX(2,H) by fractional linear transformations. We regarded H as a real form of the 
space of complex quaternions He, and the questions of unitarity of these representations led us to 
another real form in He, namely the Minkowski space M. The conformal group of M is naturally 
identified with SU(2, 2) and acts by unitary transformations on the spaces of harmonic, left- and 
right-regular functions on M. By harmonic functions on M we mean the solutions of the wave 
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equation; similarly, left- and right-regular functions on M are solutions of the left and right Weyl 
equations, which together form the massless Dirac equations. To relate these two real forms 
of He we considered the Cayley transform which maps M into U (2) and the unit two-sheeted 
hyperboloid H 3 C M into the unit sphere S 3 C EL The quaternionic picture, however, had 
an important advantage over M - it gave a natural realization of the K-types of the unitary 
representations of SU(2, 2) as the spaces of polynomials in quaternionic coordinates. While the 
group SU(2, 2) does not act naturally on H, its maximal compact subgroup K = S(U(2) x £7(2)) 
does act there and one can identify the basis of 7f-types with the matrix coefficients of the group 
17(2) and its subgroup SU(2). 

In this work we consider analysis on another real form of He, namely the split quaternions 
Hr, and study the action of the conformal group SL(2, Mr) ~ 5X(4, R). Just as the quaternionic 
analysis on H is based on analysis on the unit sphere identified with the group SU(2), the split 
quaternionic analysis on Hr has at its foundation analysis on the unit hyperboloid identified 
with the group SL(2,M) ~ SU(1, 1). It is a classical result that the analysis on SL(2, R) has 
the discrete and continuous components corresponding to the two types of irreducible unitary 
representations of this group. All results in this paper will come in two flavors - for left- 
/ right-regular functions and solutions of the appropriate wave equation. For simplicity, in this 
introduction we only announce the results for left-regular functions. 

One of the central results of our paper is a solution of the problem of separation of the series 
on SU(1, 1) using the main formulas of quaternionic analysis on Mr, namely the counterparts 
of the Cauchy-Fueter and Poisson integrals. Again, the relationship between the analysis on Hr 
and M is an important tool of our study. We use an analogue of the Cayley transform previously 
studied in [Kou0j which now maps M into U (1, 1) and the unit one-sheeted hyperboloid C M 
into the unit hyperboloid iJ™ C Hr (Proposition I58[) . There are natural identifications ~ 
SL(2, C)/SU(1, 1) and ~ SU(1, 1), and this Cayley transform interchanges the discrete and 
continuous components on and H™. The study of harmonic analysis on SL(2,C)/ SU(1, 1) 
- also known as the imaginary Lobachevski space - goes back to Gelfand and his school [GGVJ 
and is based on the geometry of horospheres. These methods were used for the problem of 
separation of the series on SU(1, 1) in more recent works by Gindikin [Gil] IGi2] , (See also 
references therein for related work on this problem.) In our approach we realize functions on 
SL(2, C)/SU(1, 1) and SU (1,1) using harmonic extensions to the flat spaces M and Hr. This 
idea was previously explored in greater generality by Strichartz [St]. In our work the methods 
and formulas of quaternionic analysis are naturally applied to solve the problems of harmonic 
analysis on SU (1,1) and SL(2,C)/ SU(1,1). 

We study first the discrete series component of split quaternionic analysis, which goes in a 
strong parallel with the case of (classical) quaternions following the results and constructions 
of our paper |FL1| . It turns out that the discrete components of the harmonicQ, left- and right- 
regular functions on Hr yield the same unitary representations of the group SU(2, 2) as in the 
(classical) quaternionic case. The unitary structure and the identification of the representations 
become transparent after the Cayley transform relating M with U(l, 1) and mapping the tube 
domains in He (see Section 3.5 in [FCT]) into certain complex semigroups with the Shilov 
boundary U(l, 1). These are Ol'shanskii semigroups which were first introduced in |Vin] . [Olj. 

One can obtain again polynomial realizations of the discrete components of the harmonic and 
regular functions on Hr by restricting the group SU (2, 2) to another subgroup Xr = S(U(1, 1) x 
U(l,l)) and identifying the polynomial basis of XR-representations with the matrix coefficients 
of the discrete component of the group £7(1,1) and its subgroup SU(1, 1). In particular, the 
two irreducible representations of SU(2, 2) realized in the space of left-regular functions on 

x By harmonic functions on Hr we mean the solutions of the ultrahyperbolic wave equation, which is in parallel 
with the Minkowski case M. 
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Hr are decomposed with respect to the shifted degree operator deg = deg+1 as follows: 



V~ = ©V-(n), V+ = 0V + (n) 



(1) 




where V~(n) (respectively V + (n)), are the irreducible representations from the holomor- 

phic (respectively antiholomorphic) discrete series, and the case n = corresponds to the limit of 
the holomorphic (respectively antiholomorphic) discrete series. Then the Fueter formula yields 
projections of the space of left-regular functions / onto the holomorphic or antiholomorphic 
discrete series components depending on the domain of the variable W £ T T in 



where *dZ is a certain naturally defined quaternionic-valued differential 3-form on Hr and 
/>o (respectively P^ /<o) denotes the sum of the components in ([I]) of positive (respectively 
negative) shifted degree (Theorem I49p . Note that the components P^ />o an d P^ /<o enter 
with opposite signs and the limits of the discrete series would cause the integral to be divergent. 
(In the case of Poisson formula the limits of the discrete series are projected out.) Since ~ 
SU(1, 1) lies inside the Shilov boundary of T^, the values of the functions on i?| can be recovered 
by taking limits. The Fueter formula for the right-regular functions and the Poisson formula for 
harmonic functions have similar structures. The results and formulas for the middle series of 
representations of SU(2, 2) obtained in |FL1] have even more exact analogues for the discrete 
component of split quaternionic analysis. In particular, the limits of the discrete series do not 
occur in the restrictions of these representations to i?R. 

Fundamentally new features of split quaternionic analysis appear when we study the continu- 
ous series component. Now the space of harmonic functions on Hr of the continuous series com- 
ponent gives rise to a single irreducible representation of the conformal group SX(4, M)/{±1} ~ 
50(3,3), known as the minimal representation^]. It was studied for an arbitrary signature in 
[Kob0] (also see references therein for the previous work on this subject). Again, the represen- 
tation theory of 5L(4,M) is crucial for studying the continuous component of split quaternionic 
analysis. On the other hand, the latter illuminates various aspects of the representation theory. 
In particular, applying the Cayley transform to the space of harmonic functions on Hr span- 
ning the minimal representation, we realize the minimal representation in a space with basis 
consisting of certain harmonic polynomials on M. This basis appears naturally when we restrict 
the minimal representation of SX(4, M) to its subgroup Km = K >0 x SL(2,C). Decomposing 
Djjj with respect to the shifted degree operator deg on M yields 



where each P^j(n), n £ Z, is an irreducible representation of SX(2, C) and can be decomposed 
further into the irreducible polynomial subspaces with respect to the compact subgroup SU(2) C 
SX(2,C). This description also gives an explicit realization of the K-types of the minimal 
representation relative to the maximal compact subgroup K' = 50(4) C 5X(4, M). The Poisson 
and Cauchy-Fueter integrals provide us projections onto the discrete component on M, but now 
the procedure is more subtle than in the case of discrete series projectors in Hr such as ([2]). 
The projection is obtained as a boundary value of these integrals in the sense of hyperfunctions, 

2 Strictly speaking, 5*0(3, 3) does not have a minimal representation, so by "minimal representation of SO(3, 3)" 
we mean the representation (zu p ' q , V p ' q ) of 0(p, q) in the notations of |Kob0| for p = q — 3. When p + q is an 
even number greater than or equal 8, one gets a genuine minimal representation. 



i r (z-w)- 1 

2^ J Z£Hi det(Z-W) 



■ *dZ ■ f(Z) = (P* / >0 - P T f <0 )(W), 



(2) 
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namely as a limit of the difference of two integrals. Thus for the Fueter integral we obtain the 
following result: 



where 



lim (*(W, ie) - -ie)) = (p^( M ) / >0 - P *«t(M) /<q ) (3) 

and p rfiscr (M) is the p ro j ec tion of the space of left-regular functions on M onto the discrete series 
component (Theorem 184"]) , Note that, as in the case of the discrete series projectors on Hr ([2]), 

pdiscr(M) j >q and F discr{M) j <q enter opposite signs and the f unct ionS / with deg/ = 

would cause the integrals to be divergent. (In the case of Poisson formula the functions in 
DjJj(O) are projected out.) Thus we can view P^(0) as the limit of the discrete series on 
iZ*~5L(2,C)/Stf(l,l). 

Finally, we return to the HjR-setting and study the continuous series component by applying 
the Cayley transform to the discrete series component on M. Quite surprisingly, the Poisson and 
Cauchy- Fueter integrals do not give the projectors as in (|3|), (|4|), but instead become diagonal 
operators commuting only with the subgroup S(GL(2,M.) x GL(2,R)) of the conformal group 
SL(4, R), and the diagonal density is precisely the inverse of the Plancherel density of SL(2, R)! 
Recall that in the parameterization of the continuous series by x = (^> e )> where / = — | + iX, 
A 6 K and e £ {0, |}, the Plancherel density is given by 



PKx) 



Atanh(7rA) if e = 0; 
Acoth(7rA) if e = \. 



(See, for example, |Va| .) Then we have the following identity 

li m ($(W,ie)-$(W,-ie)) = ^^, WGSU(1,1), (5) 
£ ^o+ v Pl(x) 



1 f ^Px(X) 



where 

V ; 2^2 J XeSU{1>1) det(X -W) + ie y ' 

and (f x (X) belongs to the linear span of matrix coefficients of the irreducible representation 
corresponding to x = (1> E ) (Theorem I94jl . We remark that for the discrete series of SL(2,R) 
the Plancherel density is —{21 + 1) and we could rewrite the Poisson integral for the discrete 
series projector in a form similar to ([5])-([6| using the kernels (det(X — W) ±ze) . Thus quater- 
nionic analysis over the split quaternions Hjr naturally reveals the important salient features of 
harmonic analysis on S'L(2,1R). 

In |FL2] we differentiate the family of operators Pl/j introduced in Theorem 1941 with respect 
to R and show that the effect of ^ Pl/j on the discrete and continuous series components 
can be easily computed using the Schrodinger model for the minimal representation of 0(3, 3) 
and the results of Kobayashi-Mano from [KobMj, particularly their computation of the integral 
expression for the operator Tc- This provides an independent verification of the coefficients 
involved in Theorems [92] [94] 

To summarize our studies of quaternionic analysis on H in |FL1] and split quaternionic 
analysis on Hr in this work we would like to point out once again the special role of the 
Minkowski space M related to the two algebras of quaternions by the two types of Cayley 
transform. Thus analysis on H and is equivalent to analysis on the two-sheeted and one- 
sheeted hyperboloids in M respectively. Moreover, doing analysis on M in many ways facilitates 
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and clarifies analysis on H and Hr. The relation between H, Hr and M also reveals the hierarchy 
of the symmetry groups of these three spaces, which can be presented as follows: 



50(5,1) 50(4,2) 50(3,3) 

\ / \ / 

50(4,1) 50(3,2) 

/ \ / \ 

50(4) 50(3,1) 50(2,2) 

I I I 

2,2 



(In this diagram some groups are replaced with locally isomorphic ones.) Clearly, the groups 
at the bottom of the diagram are the metric-preserving transformations of the three real forms 
of He of our interest, while the groups at the top row are the corresponding conformal groups. 
The groups in the middle row appear as subgroups of the conformal groups preserving the 
hyperboloids. Thus the Minkowski space literally plays the central role in quaternionic analysis 
on He and its real forms H and Hr. 

In the same way as various results in quaternionic analysis on H can be generalized to Clifford 
analysis on arbitrary Euclidean spaces (the book |GSp| contains a comprehensive bibliography 
on these subjects), split quaternionic analysis on Hr. as well as analysis on the Minkowski space 
M can be further extended to Clifford analysis on real vector spaces of arbitrary signature. How- 
ever, quaternionic analysis on H, Hr and M is singled out because of its relation to the harmonic 
analysis on the simplest groups SU(2), 5L(2,M) and homogeneous spaces SL(2,C)/SU(2), 
5L(2, C)/SL(2, R) as well as uniqueness of the space of quaternions H. Moreover, we believe 
that the special role of the four-dimensional case will reveal itself at deeper levels in the future 
developments of the subject when the relation with exotic smoothness in four-dimensional topol- 
ogy and renormalization in four-dimensional quantum field theory becomes more transparent. 

By design, analysis on the Minkowski space has many connections with the four-dimensional 



physics. In our previous paper |FL1| we noted several relations between representation theory 
underlying quaternionic analysis and Feynman diagrams. Split quaternionic analysis adds an- 
other important connection between the mathematical and physical structures. To make the 
connections with physics more apparent, in both cases we consider various results of quater- 
nionic analysis over H and Hr in the Minkowski space realization. The projectors onto the 
continuous and discrete components on M are expressed using the kernels: 

1 ' 1 ' Z = Y-W, (7) 



det Z + ie z° ' det Z-iez ' det Z + ie' det Z 



ie 



z° denotes the time coordinate of Z, in the case of Poisson integrals and their Vy-derivatives 
in the case of Cauchy-Fueter integrals. But these are precisely the massless singular functions 
that form the foundation of the theory of Feynman integrals! (See, for example, |BSh| .) Any 
other singular function appearing in physics is a linear combination of the ones listed in (J7J. 
Since there is a linear relation between these kernels: 

1 111 
+ -r-—=, —K = ; . „ . . + 



det Z + iez° det Z - iez° det Z + ie det Z - ie ' 

there are only three essentially different kernels in the list (|7|), which is exactly the number 
of su(2, 2)-irreducible components of the space of functions on imaginary Lobachevski space 
5L(2, C) /SU(1, 1)! Thus the problem of separation of the series on SL(2, R) and 5L(2, C) /SU(1, 1) 
which was solved by means of quaternionic analysis, inevitably leads to the heart of four- 
dimensional quantum field theory! Unfortunately, our representation-theoretic approach does 
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not naturally include the massive versions of the singular functions in (j7]). However, in our forth- 
coming work [FL3] we will show that, in spite of the enormous rigidity of quaternionic analysis, 
it is possible to make a one-parameter deformation that we expect to include the missing mass. 

The paper is organized as follows. In Section 2 we introduce notations and overview basics 
of split quaternionic analysis. In particular, we derive an analogue of the Cauchy-Fueter formula 
for regular functions on Hr. We also give the bases for the spaces of harmonic, left- and right- 
regular on Hr. In Section 3 we study the discrete series component of split quaternionic analysis 
(over Hr). First we find the polynomial bases of the spaces of harmonic, left- and right-regular 
functions D, V, V and describe the action of the Lie algebra sl(4, C) in those bases. After a 
brief review of Ol'shanskii semigroups, we obtain expansions of the Poisson and Fueter kernels 
in terms of the matrix coefficients of the discrete series of SU(1, 1). From these expansions we 
derive the discrete series projectors. In Section 4 we prove that the Cayley transform between 
Hr and M interchanges the discrete and continuous series components on Hr and M. Using 
results of Section 3 we obtain the continuous series projectors onto the same spaces T>, V and 
V' in the new setting of the Minkowski space. Then we study the minimal representation of 
SX(4, R) realized in the space of harmonic functions on M, find a polynomial basis for the K- 
types and use that basis to derive the discrete series projector. In Section 5 we study the Poisson 
integrals and their effect on the discrete and continuous series on Hr. We end this section with 
the proof that the boundary value of the Poisson integral in the sense of hyperfunctions yields 
a diagonal operator with density given by the inverse of the Plancherel measure of the group 
SL(2, R). In the Appendix we give a brief introduction to the special functions that we use 
throughout the paper and list their properties. 

The first author was supported by the NSF grants DMS-0457444 and DMS-1001633; the 
second author was supported by the NSF grant DMS-0904612. 

2 Split Quaternionic Analysis 

2.1 The Quaternionic Spaces H c , H K and M 

In this article we use notations established in |FLlj . In particular, eo, e\, e 2 , e% denote the 
units of the classical quaternions H corresponding to the more familiar 1, i, j, k (we reserve 
the symbol i for \/— T G C). Thus H is an algebra over R generated by eo, ei, e 2 , e3, and the 
multiplicative structure is determined by the rules 

e ei = e^eo = e i: (ei) 2 = -e , e%ej = -e^e,-, 1 < i < j < 3, 

and the fact that HI is a division ring. Next we consider the algebra of complexified quaternions 
He = C ® EL We define a complex conjugation on He with respect to H: 

Z = z°e + z 1 ei + z 2 e 2 + z 3 e 3 H> Z c = z°e + z l e\ + z 2 e 2 + z 3 e 3: z°, z 1 , z 2 , z 3 G C, 
so that H = {Z E He; Z c = Z}. The quaternionic conjugation on He is defined by: 

Z = z°e + z 1 ei + z 2 e 2 + z 3 e 3 h-> Z + = z°e - z l e\ - z 2 e 2 - z 3 e 3 , z°, z 1 , z 2 ,z 3 G C; 
it is an anti-involution: 

(ZW) + = W + Z + , VZ, W G Etc. 
We will also use an involution 

Z 1 y Z = — e 3 Ze 3 (conjugation by 63). 
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Then the complex conjugation, the quaternionic conjugation and the involution Z i-> Z~ com- 
mute with each other. 

In this article we will be primarily interested in the space of split quaternions Hr which is a 
real form of He defined by 

Hr = {Z £ H c ; Z c " = Z} = {R -span of e , h = ie±, e 2 = -ie 2 , e 3 } 

and the Minkowski space M which is regarded as another real form of He: 

M = {Z e H c ; Z c+ = -Z} = {R -span of e = -ie , e u e 2 , e 3 }. 

On He we have a quadratic form iV defined by 

N{Z) = ZZ + = Z + Z = (z ) 2 + (z 1 ) 2 + (z 2 ) 2 + (z 3 ) 2 , 

hence Z^ 1 = Z + /N(Z). The corresponding symmetric bilinear form on He is 

(Z,W) = ^Tr(Z+W) = ^Tr(ZW + ), Z,W£M C , (8) 

where Tr Z = 2z° = Z + Z + . When this quadratic form is restricted to H, Hr and M, it has 
signature (4,0), (2,2) and (3,1) respectively. 

We will use the standard matrix realization of H so that 

1 0\ / -A A) -l\ f-i 



and 



eo= i i ' 61 = \-i o ' 62 = i o ' 63 ^ v o i 



H = {Z G H c ; Z c = Z} = \ Z = ( Zl1 Zl2 ) e H c ; z 22 = zTJ, z 21 = -m 
Then He can be identified with the algebra of all complex 2x2 matrices: 

the quadratic form N(Z) becomes det Z, and the involution Z i-> Z~ becomes 
zn ^12^ = f 1 M Z f 1 °^ = f Zl1 _Zl2 

Z21 ^22/ ~ V° _1 / \° _1 / _ \~ z 21 Z22 

The split quaternions Hr and the Minkowski space M have matrix realizations 
= <j Z = [ Zn ) S H c ; Z22 = ^TT, ^21 = ^12 ^ ' 

\Z21 ^22/ 

= <{ Z - ( Zu Zl2 ) e H c ; zn, z 22 € zM, z 2 i = -2T2 

From this realization it is easy to see that the split quaternions form an algebra over R isomorphic 
to gl(2,R) and the invertible elements in Hr, denoted by H^, are nothing else but GL(2,R). 
We regard SX(2,C) as a quadric {N{Z) = 1} in H c , and we also regard SU(1, 1) ~ SL(2,R) 
as the set of real points of this quadric: 

SU( l. I.) - [Ze Hj_: V(Z) - Jf-<jZ= ^ 6H R ; detZ = |z n | 2 - |z 12 | 2 = l|. 
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The group 



a Q ° c ): i,tE : . N(a) l} C (71(2. li, ) (0) 



is naturally isomorphic to SL(2, C) and acts on the unit hyperboloid of one sheet if = {Y 6 
M; N(Y) = 1} transitively. The stabilizer group of e 3 £ .ff is 

q a ° c ) iV(a) = l| ~ Stf (l, l). 

Thus the hyperboloid H - also known as the imaginary Lobachevski space - is naturally iden- 
tified with the homogeneous space SL(2, C)/SU(1, 1). 

The algebra of split quaternions Hr is spanned over R by the four matrices 

1 0\ _ f0 1\ . /OA /-* 



eo= lo lj' 61 = U o)> 62 = U oj' 63 \0 / 

so 

/ ryi ii /-v» 3 1 I ri fy* 2 \ 

x u e + x ei + x e 2 + x°e 3 = i . 2 n o ; x , a; , re , a; € 

V a; — x + w y 

The quaternionic conjugation in this basis becomes 

eo = e o, e| = -§i, e^ = -e 2 , e^" = -e 3 . 

The multiplication rules for Hr are: 

eo commutes with all elements of Mr, 

§1; ^2) 63 anti-commute, 

e o = g l = g l = e o, e| = -e , 
eie 2 = e 3 , e 2 e 3 = -e"i, e 3 e"i = -e 2 . 

The elements eo, e*i, e 2 , e 3 are orthogonal with respect to the bilinear form (J8| and (eo,en) = 
(e 3 ,e 3 ) = 1, (ei,ei) = (e 2 ,e 2 ) = -1. 

Similarly, the Minkowski space M is a subspace of He spanned over R by the four matrices 

i \ / -A /0 -A /-i 



Define a norm on He by 

||z|| = 4=VM 2 + M 2 + k2i| 2 + k2 2 | 2 , z=f Zn Meic, 

so that ||ej|| = 1, < i < 3. 

The (classical) quaternions H are oriented so that {eo, ei, e 2 , e 3 } is a positive basis. Let 
dV = dz° Adz 1 Adz 2 Adz 3 be the holomorphic 4-form on He determined by dV(eo, ei, e 2 , e 3 ) = 1, 
then the restriction dV\^ is the Euclidean volume form corresponding to {eo, ei, e 2 , e 3 }. On the 
other hand, the restriction dV L, is also real- valued and hence determines an orientation on Hro 
so that {eo, e\, e 2 , e 3 } becomes a positively oriented basis. The orientation on M was defined in 
[FLlJ so that {eo, ei, e 2 , e 3 } is a positively oriented basis. 

In |FL1| we defined a holomorphic 3-form on He with values in He 

Dz = eodz 1 A dz 2 A dz 3 - adz A dz 2 A dz 3 + e 2 dz° A dz 1 A dz 3 - e 3 dz° A dz 1 A dz 2 
characterized by the property 

(Z 1 ,Dz(Z 2 , Z 3 , Z A )) = X - Tr(Z+, Dz(Z 2 , Z 3 , Z 4 )) = dV{Z u Z 2 , Z 3 , Z A ) 

for all Z\, Z 2 , Z 3 , Z A S He- Let Dx = Dz\ n and Dx = Dz\„. 
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Proposition 1 The 3-form Dx takes values in Hr. If we write X = x°eo + x 1 e~i+x 2 e 2 +x 3 e 3 £ 
Hr, x°,x ,x 2 ,x 3 € R, i/ien Dx is given explicitly by 

Dx = eodx 1 A dx 2 A dx 3 + e\dx° A dx 2 A dx 3 - e 2 dx° A dx 1 A dx 3 - e 3 dx° A (fx 1 A dx 2 . (10) 

Remark 2 Clearly, the form Dx satisfies the property 

(X 1 ,Dx(X 2 ,X 3 ,X i )) = ^Tr(X+,Dx(X 2 ,X 3 ,X 4 )) = dV(X 1 ,X 2 ,X 3 ,X 4 ) 

for all X\,X 2 ,X 3 ,X4 G Hr, which could be used to define it. 

Let £/ C Hr be an open region with piecewise smooth boundary dU. We give a canonical 
orientation to dU as follows. The positive orientation of U is determined by {eo,e~i,e 2 ,e 3 }. 
Pick a smooth point p 6 dU and let n p be a non-zero vector in T p Hr perpendicular to T p dU 
and pointing outside of U. Then {ti,t 2 ,t^} C T p dU is positively oriented in 9^7 if and only 
if {n p , T\, t 2 , Ts} is positively oriented in Hr. We orient SU(1,1) and, more generally, hyper- 
boloids H R = {X e Hr; iV(X) = i? 2 } as the boundaries of the open sets {X £ Mr; N(X) < R 2 }. 

Lemma 3 Let R £l be a constant, then we have the following restriction formula: 

n I v dS 

Dx ^n =x jxjy 

where dS denotes the restrictions of the Euclidean measure on Hr to Hr. 

We recall some notations from |FLlj . Let § be the natural two-dimensional complex repre- 
sentation of the algebra He- We realize it as a column of two complex numbers, then He acts on 
S by matrix multiplication on the left. Similarly, we denote by §' the dual space of S, this time 
realized as a row of two complex numbers. We have a right action of He on §' by multiplication 
on the right. 

2.2 Regular Functions on H and He 

Recall that regular functions on H are defined using an analogue of the Cauchy-Riemann equa- 
tions. Write X £ H as X = x°eo + x x ei + x 2 e 2 + x 3 e 3 , x ,^ 1 ,^ 2 ,^ 3 E R, and factor the 
four-dimensional Laplacian operator □ on H as a product of two Dirac operators 

d 2 t d 2 , d 2 i d 2 _ + _ + 
~ (dx ) 2 + (dx 1 ) 2 + (dx 2 ) 2 + (dx 3 ) 2 ~ 

where 

v+ = e 0T^ + eiTr^r + e 2 TT^- + e 3 T^- and 
V = e - 

The operators V + , V can be applied to functions on the left and on the right. For an open 
subset U C H and a differentiable function / on U with values in H, S or He, we say / is 
left-regular if (V + f)(X) = for all X G U. Similarly, a differentiable function g on U with 
values in H, §' or He, is right-regular if (g\7 + )(X) = for all X G U. 



d 


d 


d 


d 


dx° 


61 dx 1 


2 dx, 2 


3 dx 3 


d 


d 


d 


d 


9x° 


61 dx 1 


2 dx, 2 


3 dx 3 
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Proposition 4 For any C 1 -functions f : U — > S and g :£/—>■ S', where U C M is an open 
subset, 

d(Dx ■ f) = -Dx A df = (V+/) dV\ w d{g ■ Dx) = dg A Dx = ( 5 V+) dV| H . 
In particular, 

V+/ = DxAdf = 0, #V+ = dg/\Dx = 0. 

Let ?7 C C He be an open set. Following [FLlj . we say that a differential function on U c with 
values in C, He, § or §' is holomorphic if it is holomorphic with respect to the complex variables 
z°, z 1 , z 2 , z 3 . Then we define / c : U c — > § to be holomorphic left-regular if it is holomorphic 
and V + / c = 0. Similarly, g c : U c — > §>' is defined to be holomorphic right-regular if it is 
holomorphic and g c V + = 0. Finally, we call a function if : U c — > C holomorphic harmonic if it 
is holomorphic and □</? = 0. 

If we identify He with complex 2x2 matrices [ Zl1 Zl2 ) , Zu G C, then a function is 

V z 2i Z22J 

holomorphic if and only if it is holomorphic with respect to the complex variables Zij, 1 < i,j < 2. 
For holomorphic functions f c : f/ c — > § and g c : U c — > the following derivatives are equal: 



9zi2 dz 



ii 



5 5 c . / _d_ d_ 

dz° u ' dz 1 1 ' dz 2 * ' 



Cv7+ ug uy uy uy c q— -q^~ 



<9zi2 9z 



ii 



V/ C = e o§^-e 1 §^-e 2 §^-e 3 §^ = 2(4T S§T ) / c, 

dz 1 dz 2 dz 5 \^t 2 wtJ 



qC qC qC QC 



Since we are interested in holomorphic functions only, we will abuse the notation and denote 
by V and V + the holomorphic differential operators -£peo — ^r^i — -§£i^2 — ~^ e 3 an d e 0^n + 
ei af r + e2 af^ + e 3af^ respectively. 

Proposition 5 For any holomorphic functions / c : U c — > § and g c : U — > S', 

V + / c = <=^ Dz A df c = 0, g c V + = ^> dg c ADz = 0. 
Lemma 6 We have: 

L u nW) = °; 

Vt^ = -JrmV = -2 = -2 z+ ■ 



N{Z) N{Z) v nW) N{zy ' 

^" jv(Z) = jvfzp * s a holomorphic left- and right-regular function defined wherever N(Z) ^ 0; 

^. The form jj-^-Dz = N ^ z yi -Dz is a closed holomorphic Mc-valued 3-form defined wherever 
N(Z) ^ 0. 
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Lemma 7 For any differentiable function ip : U c — > C, we have: 

V(^(Z+)) = (VV)(Z+), V + (v(Z + )) = (V<p)(Z+), 

We will often use the shifted degree operator 

~ d d d d 

deg = 1 + *> W + z 1 ^ + z 2 ^ + z 3 — 

(the degree operator plus identity). By direct computation we obtain 

Lemma 8 

2(dei + 1) = Z+V+ + VZ = V+Z+ + ZV. (11) 

Next we describe actions of the group GL(2,Hc) on the spaces of left-, right-regular and 
harmonic functions on He with singularities by conformal (fractional linear) transformations. 
Let 

h = € GL(2,M C ) and write h~ x = ^ . 

On the space of left-regular S- valued functions GL(2,Hc) acts by 

*i{h):f(Z) ^ (7r l (h)f)(Z) = ^±^ .f((aZ + b)(cZ + d)- 1 ). 

On the space of right-regular S'-valued functions GL(2,Hc) acts by 

Mh) : g(Z) ^ Mh)g)(Z) = g((a' - Zdy\-b' + Zd')) • ( °' ( ~ . 

On the space of C- valued harmonic functions we have two different actions: 

TT?(h): <p(Z) ^ (ir?(h)v) (Z) = J - - • y((aZ + b)(cZ + d)' 1 ) , 
4(h): <p{Z) i y (4(hy)(Z) = — I — • <p((a> - Zd)~\-H + Zd')). 

These two actions coincide on SL(2, He), which is defined as the connected Lie subgroup of 
GL(2,Hc) with Lie algebra 

s((2,H c ) = {x G 0l(2,H c ); Re(Trx) = 0}. 

2.3 Regular Functions on Hr 

We introduce linear differential operators on Hr 

Ft fl 

and 





d 


9 






61 dx 1 


cte 2 


3 dx 3 


d 


„ 9 




d 


dx° 


61 Ox 1 


+ e2 9^ 


63 <9x 3 



vr = eo- 

which may be applied to functions on the left and on the right. 
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Definition 9 Fix an open subset U C Hr- A differentiable function f : Hk — >• § is left-regular 
if it satisfies 

W/) W = e ^(X) - ~ ei §L(X) - e 2 §l(X) + e 3 §L(X) = 0, Vie IT". 
Similarly, a differentiable function g : Hk — > §' is right-regular if 

(9*i)W = - ^(^i - ^ + ^ = 0, VXe 17. 

We denote by 2 the ultrahyperbolic wave operator on Hk which can be factored as follows: 

rn _ ^ ^ ^ ^ - V7 V7+ _ V7 + V7 

Abusing terminology, we call a smooth function 93 : U — > C harmonic if 02,2V 9 = 0- 
Proposition 10 For any C 1 -functions f : U —t§ and g : U —}§', 

d(Dx ■ f) = -Dx A df = (V+/) dV, d{g ■ Dx) = dg A Dx = ( 5 V+) dV, 
In particular, 

V+/ = DxAdf = 0, ^V^ = dgADx = 0. 

Let J7 C C He be an open set. The restriction relations 

Dz \a R = Dx > Dz \m= m 

imply that the restriction of a holomorphic left- or right-regular function to U K = U c n Hr pro- 
duces a left- or right-regular function on C/ R respectively. And the restriction of a holomorphic 
left- or right-regular function to £7jn = U c n H also produces a left- or right-regular function 
on Um respectively. Conversely, if one starts with, say, a left-regular function on Hk, extends 
it holomorphically to a left-regular function on He and then restricts the extension to H, the 
resulting function is left-regular on H. 

Proposition 11 Let f c : U c — > § and g c : U c — > §' 6e holomorphic functions. Then 
v r/ — v / ' V KJ — V/ , 3 V R — 5 V , 5 Vi- 5 V. 

The actions of the group GL(2, Hk) on the spaces of left-, right-regular and harmonic func- 
tions on Hk with singularities are given by the same formulas as before. 

2.4 Fueter Formula for Holomorphic Regular Functions on H K 

We are interested in extensions of the Cauchy- Fueter formula to functions on Hk- First we recall 
the classical version of the integral formula due to Fueter: 

Theorem 12 (Cauchy-Fueter Formula |F1|, [F2J ) Let [% C H be an open bounded subset 
with piecewise C 1 boundary (9L%. Suppose that f(X) is left-regular on a neighborhood of the 
closure Uu, then 



2tt 2 J dUn N(X - Xq) ' X ' H 10 ifX $U m . 



If g(X) is right-regular on a neighborhood of the closure Uu, then 

1 f ,^ ^ (X-Xo)- 1 \g(X ) ifX eU m ; 



[ g(x) ■ Dx 

JdU w 



2vr 2 J dUn ' N(X-X ) ifX <£U B . 
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Let U C Hr be an open subset, and let / be a (^-function defined on a neighborhood of U 
such that Vjj/ = 0. In this subsection we extend the Cauchy-Fueter integral formula to left- 
regular functions which can be extended holomorphically to a neighborhood of U in He- Observe 

that the expression in the integral formula ^f^" ! . • Dx is nothing else but the restriction to 

N[X—X ) 

EI of the holomorphic 3-form \ °~. - • Dz, which is the form from Lemma [6] translated by Xq. 

N(Z—X ) 

For this reason we expect an integral formula of the kind 



■f(X), VX G U. 



However, the integrand is singular wherever N(Z — Xq) = 0. We resolve this difficulty by 
deforming the contour of integration dU in such a way that the integral is no longer singular. 
Fix an e G R and define an e-deformation h £ : He — > He, Z \— > Z e , by: 

zn !->■ zu + iez\\ Z12 H> Z12 - iezyi 

%2\ !->■ Z 2 1 - iez 2 \ Z 2 2 l-> Z 2 2 + i£Z22- 

In other words, Z E = Z + ieZ~ . For Zq G He fixed, we use a notation 

h £ ,z (Z) = Z + h £ (Z-Z ) = Z + ie(Z - Zq)-. 

Lemma 13 Define a quadratic form S{Z) = Z\\%22 + ^12-221 on He- We have: 

N(Z £ ) = (1 - e 2 )N{Z) + i2eS(Z), 

S(X) = \\X\\ 2 , VX G H R . 

Theorem 14 Let U C Hr be an open bounded subset with piecewise C 1 boundary dU, and let 
f(X) be a function defined on a neighborhood of the closure U such that Vj£/ = 0. Suppose that 
f extends to a holomorphic left-regular function on an open subset V c C He containing U , then 



J_ [ (Z-X )-i f c (z)= if(Xo) PoeP; 

27r2 J(h e>Xo )*(8U) N(Z -X ) { > \q tf X i U. 



for all e ^ sufficiently close to 0. 

Remark 15 For all e 7^ sufficiently close to the contour of integration (h E> x )*(dU) lies 
inside V c and the integrand is non-singular, thus the integrals are well defined. Moreover, the 
value of the integral becomes constant when the parameter e is sufficiently close to 0. Of course, 
there is a similar formula for right-regular functions on Hr. 

The proof is similar to the proof of Theorem 51 in [FLlJ; for this reason we just give an 
outline. Since the integrand is a closed form, by Stokes' we are free to deform the cycle of 
integration as long as we stay inside the set 

{Z G V € ; N(X -Z) + 0}. (12) 

Let S r = {X G H + Xq; \\X — Xq\^ = r 2 } be the sphere of radius r centered at Xq and lying in 
the subspace of He parallel to H. We orient S r as the boundary of the open ball. One can show 
that, for r > sufficiently small, the cycle of integration (h Et x )*(dU) is homologous to —S r if 
Xq G U and if Xq ^ U as homology 3-cycles in (j 1 2 [) . Then the result follows from the Fueter 
formula for the regular quaternions (Theorem 1 12 p . Alternatively, one can let r — > + and show 
directly that the integral remains unchanged and at the same time approaches —2-K 2 f(Xo) in 
the same way the Cauchy and Cauchy-Fueter formulas are proved. 

One can drop the assumption that f{X) extends holomorphically to an open neighborhood 
of U in He and prove the following version involving generalized functions: 
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Theorem 16 (Integral Formula) Let U C Hr be a bounded open region with smooth bound- 
ary dU . Let f : U — > He be a function which extends to a real- differentiate function on an 
open neighborhood V C Hr of the closure U such that Vjt/ = 0. Then, for any point Xq G Hr 
such that dU intersects the cone {X G Hr; N(X — Xq) = 0} transver sally, we have: 

lim-^/ tX-X Q )+ ^ Dt . m J^ ifX ^^ 

e^o 2vr 2 J xedu (N(X-X ) + ie\\X-X \\ 2 ) 2 [0 ifX (£U. 

The proof of this theorem is given in (E]. 
2.5 The Matrix Coefficients of SU(l, 1) 

The matrix coefficients of the (generalized) principal series representations are functions of 
Z G SU (1,1) given by 

t m (Z) = ^ ( f(sz 11 + z 21 ) l ~ m (sz 12 + z 22 y^ S - 1 ^, Z=( Zn Zl2 ), (13) 

— 2m J s \z 2 \ z 22 ) 

where the integral is taken over the unit circle {s G C; \s\ = 1} traversed once in the counter- 
clockwise direction |Vil] . The parameters m and n are either both integers or half-integers: 

m,n£Z or m, n G Z + — , and I € C. 

When the parameters l,m,n range over 

13 5 
Z = --, -1,--, -2, , m,neZ + l, m,n>-l, 

we get the matrix coefficients of the holomorphic discrete series representations (I < —1) together 
with its limit (I = —1/2). When the parameters l,m,n range over 

13 5 
/ = --,-1,--, -2, m,nGZ + /, m,n < I, 

we get the matrix coefficients of the antiholomorphic discrete series representations (I < — 1) 
together with its limit (Z = —1/2). When the parameter Z ranges over 

l = --+i\, Ael, 

we get the matrix coefficients of the continuous series representations and the two limits of 
the discrete series (A = and m,n G Z + i). Formula fj 1 3 P involves complex numbers raised 
to complex powers, and we need to clarify it so there is no ambiguity. In the discrete series 
situation the powers Z ± m are actually integers, so there is no ambiguity at all. In the general 
case Z G C we write 

(sz n + z 21 ) l - m (sz 12 + z 22 ) l+m s- l+n = (sz n + z 21 ) l ~ m (z 12 + s~ l z 22 ) l+m s m+n 

= \sz u + z 2l \ 2 «~ m \z 12 + s~ l z 22 ) 2m s m+n 

(recall that Z22 = Z\i, 212 = -221, s 1 = s). The expression \sz\\ + z 2 i\ 2 ^~ m " > is well defined 
because \sz\x + z 2 \\ is a positive real number, and the expressions (z\ 2 + s^ 1 z 22 ) 2m , s m+n are 
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well defined as well since the powers 2m, m + n are integers. For certain values of I, m, n, the 
matrix coefficients vanish: 



,/ 1.3 



m > —I. n < —I 



t nm (Z) = when / = 0,--,-l, and or (14) 

m < I, n > I. 

We give another expression for the matrix coefficients (113|) also due to Vilenkin [Vil] . Fix a 
parameterization of the group SU(1, 1) which is essentially the KAK decomposition: 

f n • ^ i ■ 9\ / it- jV+jt . , T j v-i> \ 
, _ i x — «x x + ix \ _ I cosn 2 • e 2 smh 2 ' e 2 \ 

X{<P > T ^-W-ix 2 x° + ix* ~ Us- cosh 5- e"^ 



cosh 5; 


,■ <p+i> 
■ e 2 


sinh 


• e 2 




1 


Co 


e-'i 



2 



I sinh 77 cosh 5/ \ q 



/ ■ «4 

e l 2 



(15) 



with < (p < 2ir, < r < 00, —2tt < ip < 2tt. Then we have the following expressions for the 
Haar measure on SU(1, 1): 

dx 1 A dx 2 A dx 3 sinh r , , , , — -1 

d<p A dr A dip = Dx ■ X^ 1 - 



x° 8 r r ... - 

In terms of the parameterization (|15p . the coefficients t l nm (X), X £ SU (1,1), can be written as 

t l nm &,T,i>) = e -*C«^) .^ m (coshr), (16) 

where, by definition, 

, . , . 1 // , T , T\ l ~ m f , T , T\ i+m -l+r,ds 

vp„ m (cosh r) = As cosh — h sinh— I Is sinh — h cosh - s — . 

2-7T? / \ 2 2/ V 2 2/ s 

The functions *P^ m (coshr) are real- valued when I G R. Moreover, 



Vnm(coshr) = ^ m (coshr) 



q}^ n (coshr) =q3L m _ n (coshr) = (-^^^^coshr) 

, 4- urn. - Hill 

<P nm (cosh-r). 



r(/ + n + l)r(/-n + l) . 



r(z + m + i)r(z - m + 1) 

(When 1 £ two of the T-factors become infinite and must be transformed by the formula 
r(x) • r(l — x) = 7r/ sin(7rx).) They also satisfy the orthogonality relations: 



/°o 1 
¥ l mn (t)-^ n (t)dt = if///', l,l',m,ne-l 



(17) 



fV ml 2 ^-r 11™-™ " 2 r(/ + m + i)r(/-m + i) 3 

A cft-(-l) 2Z + 1 r{l + n + mi _ n + 1) , l--l,--,~2,.... (18) 

The functions ^^^(coshi) can be expressed in terms of the hypergeometric function. We will 
use 

?L(cos1it) 

r(Z — m + 1) (cosh 5) m+n (sinh £) n m / , ,t\ , , 

= - ^ , ^7 2*1 / + n + l,-/ + n;n-m + l;-sinh 2 - 19 

1 (/ — n + l)(n — mj! V 2/ 

(valid for n > m) found in Subsection 6.5.3 of |VilK| . 

Let Hj^ = {X 6 Hr; N(X) > 0}. Clearly, the matrix coefficient functions t l nm extend from 
SU(1, 1) to Hjt. Differentiating (jl 3[) under the integral sign we obtain: 
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Lemma 17 



3 -t l nm (Z) = (l- m)t l JiJZ), -^-t l nm {Z) = (l + m)t l J L AZ), 



3 -t l nm (Z) = (l-m)i\\ m ^_(Z), ^-t l nm (Z) = (l + m)t l J lm _,(Z). 



az 2 i - ' v ' " dz 22 



We also have the following multiplication identities for matrix coefficients. 
Lemma 18 

t 1 * (Z),t\ (z))( zu Zl2 ) = U ,{z),t l MZ) 

m+±n v n m-±n} ') \z 2 \ Z 22 J V mn_ 5 mn+ 2 K - ' 



and 

\ ({l-m + \)t l ,{Zf 

Z U Z 12 \ I y 2^ n m+^ > 

Z2t z 22 J Ul + m+±)t l nm _i(Z) 



({l-n + l)t l+ \ (Z) 



n— ± m 



(l + n+fy^A (Z) 

v / r)._U — ro x ' 



Applying U 2 ,2 = dzi f dz22 - dzi f dz21 and using Lemma El we obtain: 
Proposition 19 On H^ we have: 

D 2>2 t l nm (Z) = and D 2>2 N(Z)- 1 ■ t^Z' 1 ) = 0. 

Applying V + = 2 I ^'^j 1 dz § x ] and using Lemma H71 we obtain: 

\dz\2 8Z22 / 

Proposition 20 The following S-valued functions on Hj^ 



are left-regular. Dually, the following §' -valued functions on Hj^ 

ff l+ ^ (Z^ 1 ) t + ^ (Z^ 1 )) (t ^ (Z) t ^ (Z) 



iV(Z) v ' 
are right-regular. 

Next we would like to extend the matrix coefficients (jl~3|) holomorphically from H^ to an 
open region in He- Define an open region in He: 

U = \ Z = ( Zn 212 ) € He; \z 21 \ < \z n \, \z i2 \ < \z 22 \, Re(znz 22 ) > or lm(zuz 22 ) ^ \. 



y z 2 i z 22 

Lemma 21 The matrix coefficients Iil3\) can be holomorphically extended to U. 
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Proof. We can rewrite 

4.(2) = h /(l + S -^)'" ra (l + .^)%fcW~<*)*".*-~-. (20) 

By assumption, Re(^n^22) > or Im(^n^22) 7^ 0, which allows us to choose a single branch of 
the complex multivalued function {z\\Z22) l ~ m ■ Since \z2\\ < \zu\ and \z\2\ < | -2^22 1 5 

Re(l + s- 1 — ) > and Re(l + s— ) > 0. 

V 2n/ V Z22S 

Thus we can choose single branches of the multivalued functions (l + m and (l + 

zi2\l+m n 
Z22 > 

Let J7 + be another open region in He: 
U + = {Z G He; G C/} 

Z = ( ZU 212 ) G H c ; \zi 2 \ < \z u \, \z 2 i\ < 1 222 1, Re(znz 2 2) > or Im(ziiz 22 ) ^ 

\ z 21 ^22/ 

Observe that, for Z £ U U U + , N(Z) is never a negative real number or zero, hence arbitrary 
complex powers of N(Z) are well defined. Letting Z = Z^ 1 and writing 

we see that the matrix coefficients t nm (Zys can be holomorphically extended to U + as well. 
Now we define H+ = U U U+. 

Lemma 22 The matrix coefficients M'J\) can be holomorphically extended to H,J. 

Proof. Since the matrix coefficients extend to both U and U + , all we need to show is that we do 
not run into problems with multivaluedness on U n U + . The matrix coefficients of the discrete 
series and their limits are rational functions in jz^-'s and certainly extend to Hjt. For the matrix 
coefficients of the continuous series the result follows from the following general observation: 

Let U R be an open region in W 1 , and let and L^F be two connected open regions in C n 
such that U R C Iff H M n , i = 1,2, and every loop in Uf U is homotopic to a loop in U R . 
Suppose a real- analytic function / on ?7 R has holomorphic extensions f\ to C/p and f'2 to L^p, 
then fx = /2 on C/f n C/J an d / has a unique holomorphic extension to U f/^. O 

We view H^ as an open neighborhood of Hj£ in He, and in light of the lemma we can regard 
the matrix coefficients (|T3|) as functions on H,J . Lemma [T7] and Proposition [20] formally extend 
to complex variables and Hj^ replaced with Mq. 

We conclude this subsection with a list of relations between the matrix coefficients which 
follow from the relations between *P^ m (i)'s. When Re/ = —1/2, the functions t l nm (Z) and 
N(Z)- 1 ■ t l nm (Z/N(Z)) on H+ are proportional: ~~ 

ijz) = (-D-- ± m ± a±a . _■_ . tijzmz)), r»i=-i. (2D 

We also have 

)-(-!) r(/ _ n+1)r(/ + n+1) U^). (22) 



Combining this with (|2ip we obtain 

N(Z)- 1 ■ t l nm {Z- r ) = t l _ m _ n {Z), Re/ = -1/2. (23) 
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2.6 Schwartz Space <S(H^) and Invariant Pairings 

Definition 23 Let f be a function on (with values in C, He, § or E>'). We say f is quasi- 
regular at the origin if 

lim t 1+S f(tX) = for all X G Hit and all 5 > 0. 
If ip is a solution of the wave equation □2,2^' = on Hj£, we say if is quasi-regular at infinity 

zs quasi-regular at the origin. 

Similarly, we say that a left-regular function f or a right-regular function g on is quasi- 
regular at infinity if 

(0 i\ . x- 1 x (0 i\ u x- 1 



v i qj j n(x) jy ' ' v 1 °y WW 

z's quasi-regular at the origin. 

For example, let / be a homogeneous function on Hj£ of homogeneity degree 6 C. Then 
/ is quasi-regular at the origin if and only if Re fj, > — 1. If / is a solution of the wave equation, 
then / is quasi-regular at infinity if and only if Re/x < — 1. In particular, all matrix coefficients 
t l nm (Z) are quasi-regular at infinity; moreover, the matrix coefficients of the continuous series 
and the limits of the discrete series (Re / = —1/2) are also quasi-regular at the origin. Finally, if 
/ is a left- or right-regular function, then / is quasi-regular at infinity if and only if Re \x < —2. 

For the purposes of this article, a suitable reference for the Schwartz functions on Lie groups 
in the sense of Harish-Chandra is [Va]. Our definition of the Schwartz space on HJ, denoted by 
<S(Hj£), is motivated by the following needs: 

• If / G <S(Hjjj), then the restrictions of / to all hyperboloids Hr, R > 0, should be Schwartz 
functions in the sense of Harish-Chandra; 

• Since we often apply the deg operator, if / G <S(Hj£), then the restrictions (deg) d f\ H 
should be Schwartz functions as well, for all R > and integers d > 0; 

• Since we often perform calculations with matrix coefficients t l nm (Z), the matrix coeffi- 
cients of the discrete series and wave packets formed out of the matrix coefficients of the 
continuous series should be in S(Hjt). 

The group x HjJ acts on Hi by multiplication: 

(a, !)):I4 aXb' 1 , (a, b) G H+ x H+, X G H+ 

Hence we get an action of H^ x Hj£ on the space of smooth functions on : 

(a, b) : f(X) h+ f(aT x Xb), f G C°°(H+). 

Differentiating, we obtain an action of the Lie algebra gl(2,R) x g[(2,R) which extends to an 
action of its universal enveloping algebra ZY(g((2,R)) <g> U(gl(2, R)) on C°°(H^). 
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Definition 24 We define <S(Hjjj) - the Schwartz space on Hj^ - to be the space of smooth 
functions f on Hjj such that, for each a G U(gl(2,M)) ® U($l(2, R)) ; eac/i n G N and a// i? > 1, 
i/tere exists a constant C(a,n,R) > suc/i i/ia£ 

\a.f(X)\<C { a, n ,R).V- + '°Z™-" 



\\X\\ 

for all XeiJ such that R~ 2 < N(X) < R 2 . 

We shall regard 5(ffit) as a Frechet space with respect to the seminorms 

Ha,nAf)= SU P W- f(X)\-\\X\\-(l + log\\X\\) n . 

{XeH+; R- 2 <N{X)<R 2 } 

Denoting by C^°(Hj^) the space of compactly supported smooth functions on Hj^ we get maps 

C?(U+) ^ S(M+) ^ L 2 {SU(1,1)), 



lst/(i,i)' 



where the first map is the inclusion and the second map is the restriction map / i— y f\ 
These maps are continuous with dense images. 
Let 

H(B+) = {tp G 5(H+); n 2 , 2 <p = 0} 

be the space of "harmonic" functions in S (Hljt). Similarly we denote by S(H^) the space of 
8-valued left-regular functions and, respectively S'(Hr) the space of S'-valued right-regular 
functions on with both components in S (Hjt). Essentially by definition, the matrix co- 
efficient functions listed in Proposition [19] with I < — 1 (i.e. belonging to the discrete series) 
together with the wave packets formed out the functions with Re / = —1/2 (i.e. belonging to 
the continuous series) form a dense subset of %(Hjt). Similarly, the left- and right-regular func- 
tions listed in Proposition 1201 generate the spaces S(Hjt) and S'(Hr) respectively. That is, the 
left- and right-regular functions of Proposition [20] with entries belonging to the discrete series 
together with the wave packets formed out of the functions with entries in the continuous series 
form dense subsets of S(Hjjt) and S / (Hm) respectively. 
Fix an R > and define a bilinear form on %(Hjjj) by 

1 f dS 

(<Pi,<P2)R = -^J x ^^<pi)(X).<p 2 (X)j^ 1 <pi,<p2€n(B&). (24) 

This form is not symmetric, not sl(2, Hc)-invariant and depends on the choice of R. In Subsec- 
tion [43] we will extend the space H(M.m) to and define a symmetric s[(2, Hc)-invariant 
nondegenerate bilinear pairing on it. 

Lemma 25 Let G(Hr) C GL(2,Mq) be the subgroup consisting of all elements of GL(2,Mc) 
with entries in Hr and preserving the hyperboloid Hr = {X G Hr; N(X) = R 2 }. Then 

Lie(G(H R )) = ^ ^p^; A,C,DeM R , ReA = RzDj. 

Proof. The Lie algebra of G{Hr) consists of all matrices A,B,C,D G Hr, which 

generate vector fields tangent to Hr. Such a matrix ( ^ j generates a vector field 



d ((1 + tA)X + tB) (tCX + 1 + tD)- 1 



dt 



= AX + B- XCX - XD. 

t=o 
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A vector field is tangent to Hr if and only if it is orthogonal with respect to ([8]) to the vector 
field X for N{X) = R 2 : 

= Re((AX + B- XCX - XD)X + ) = Re(R 2 A - R 2 D + BX + - R 2 XC), G H R . 

It follows that ReA = ReD and B = R 2 C + . □ 

Corollary 26 Let G(Hr) C GL(2,Wq) be the connected subgroup with Lie algebra 
g(H R ) = {x£ Lie(G(H R )); Re(Trx) = 0} 

A f>2fi+\ 

c p J; A,C,D £ H a , Re ,4 = ReD = 

Then G(Hr) preserves the hyperboloid Hr = {X G Hr; N(X) = R 2 } and the open sets {X G 
M K ; N(X) > R 2 }, {X G M M ; N(X) < R 2 }. 

The Lie algebra q(Hr) and the Lie group G(Hr) are isomorphic to so(3, 2) = sp(2,M) and 
SO + (3, 2) respectively (see, for example, [HJ). 

Proposition 27 The bilinear pairing (ip\,ip2) R *s invariant under the Tr® action of q(Hr). 
Proof. First we find a convenient pair of subgroups generating G(Hr): 

Lemma 28 The group G(Hr) is generated by SU (1,1) x SU (1,1) realized as the subgroup of 
diagonal matrices ^ , a,d G SU(1, 1) C Hr, and the one-parameter group 

„,„ f / coshi i?sinhi\ 

G ™ = \l v i?- 1 sinht cosht )> te 

Clearly, the bilinear pairing is invariant under the ir® action of <Si7(l, 1) X SU(1, 1). Thus it 
is sufficient to show it is invariant under a one-dimensional Lie algebra q(Hr)' = Lie(G(Hpi)'). 

Lemma 29 Fix an element g = f^-lgj^t ^cosht^) ^ G(Hr)' and consider its conformal 
action on Hr: 

iTi(g) : l4l = (coshtX - Rswht^-IT 1 sinhtX + cosht) -1 . 

Then the Jacobian J of this map is 

,^{dS\dS 1 R 2 -(ReX) 2 dS 

n i(9) jr^r = J 



\X\\J \\X\\ N^R- 1 sinhtX + cosht) R 2 - (Re X) 2 \\X\ 
Rt" 



Let g = exp ( ^ ) G G(Hr)'. For t — V and modulo terms of order t 2 , we have: 

\R t J 

X = X + t(X 2 - R 2 )/R, (25) 
iV(-iT 1 sinh + cosh t) = 1 - 2t Re (26) 
i? 2 - (Rel) 2 = (i? 2 - (ReX) 2 )(l + 4tReX/i?). (27) 
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Lemma 30 Modulo terms of order t 2 we have 

SirtiW) = dS» ( Jy( _ fl _, ?™ x - cosht) ) - (1 + itReX/R) ■ (W)(X). 

Letting (pi = Tr?(g)tpi, i = 1, 2, and continuing to work modulo terms of order i 2 , we get 

-2tt 2 • {<pi,<p2) R = / deg x (£i)(X) • (p 2 {X) — - 
JxeH R ll A ll 

fiT fin l + ^ReX/i? dS 



xeH R 7 ^ y Ni-R- 1 sinhtX + cosht) ||X|| 

= / (deg x <^i)(X) • (P2(X) -~- = -2vr 2 • (ipu^R. 
Jx&Hr \\X\\ 

This proves that the bilinear pairing {ipi,(p2)R is 3 (//^-invariant. □ 

Next we calculate the pairings between the matrix coefficient functions. 

Proposition 31 The matrix coefficients hi Sty satisfy the following orthogonality relationships: 



Sii'S mm 'S nn ' if 1,1' 7^ — 1/2; 
if I or I' = -1/2, 



R 2(21+1) . ^^(X),t'_ n /_ m /(^")) fl 

__t ? 2(2/+i) / 1 f / rr- 1 ^ 1 /«' ry- 1- \\ 

_ n T(Z + m + l)r(Z - m + 1) j o~u>5 mm '5 nn > if 1,1' / -1/2; 



("l) r 



T(/ + n + l)r(/-n + l) [0 if I or I' = -1/2, 



for all R > 0, provided that I or I' lies in {— 5, — 1, — |, . . . }. In particular, we get a nondegen- 
erate pairing between the spaces of harmonic functions spanned by t l nm (X) 's and by N(X)^ 1 ■ 
t l nrn (X~ v ) 's with I = —1, — I, —2, . . . , which is independent of the choice of R > 0. 

Proof. Since the functions iV(X) -1 •tJ nn (X _1 ) andt^, m ,(X) are homogeneous of degree — 2(/ + l) 
and 21' respectively, it is sufficient to prove the result for R = 1 only. This is done by integrating 
in coordinates (jl~5j) using identities (fl~6j) and (j22~j) and the orthogonality relations for *p^ m 's (fT7|) - 
(1181). □ 



The g[(2, Hc)-invariant pairing between left-regular and right-regular functions on Hj^ is 
given by the formula 

(9,f) = -A [ g{X)-Dx-f{X) 
Z7T Jxesu(i,i) 

(provided that the integral converges). The fact that this bilinear pairing is g[(2, Hc)-invariant 
can be seen as follows. First, one can realize that if SU(1, 1) is replaced with an arbitrary 
hyperboloid Hr, the pairing remains unchanged (this follows, for example, from Proposition 
[32] below). Then, exactly as in the proof of Proposition [271 one can show that the pairing is 
invariant with respect to each algebra q(Hji). But for i?i 7^ R2 the algebras g(-ffR x ) and q(Hr 2 ) 
generate all of s£(2,Hr). Finally, one can check the invariance under diagonal matrices and get 
the g[(2, He) -invariance. 
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Proposition 32 We have the following orthogonality relationships: 



N(X) 



.(X 



(x- 1 ) 



(l> + m>)t\Z_dX) 



'{l-n + \)t l ! (x- 1 ; 



N(X) Ul + n+^t'JX 



Sll>Smm'5nri, 



Sll>5mm,'5nri, 



t\x (X),t l x (X)), 
n,A- -r m. v / 3 n— «■ m V 7 / 3 



0, 



\N(X) 



v i 

n m— ^ 



-1- 



' 7V(X) 



(l' + n')t,AAX 



-1> 



provided that I or I' — % lies in the discrete series set {— 1, — |, —2, . . . }. 
Proof. Using Lemmas [3] and [18] we obtain: 



t l ipT 1 ),*' MX- 1 ))-^- 

ran— ± y mn+^ v '/ 



-1- 



(I' - n' + 1/2) • t 1 ', ! ,(X)-i' + (/' + «' + 1/2) ! ,(A-)-t' MX" 1 ), 



/, 2 ! ,m,^', 2 i XX)) x- 




~ n + 1/2) • C„,-l(X) • ( , JI- 1 ) + (I + n + 1/2) • 1 W • t>(X^), 



then the result follows from Proposition [31] □ 



2.7 Fueter Formula for Hyperboloids 

We fix < R' < R and let U = {X £ M R ; i?' 2 < iV(X) < R 2 } be the open region in M+ 
bounded by two hyperboloids. In this section we essentially substitute this unbounded set U 
and bounded functions / into the integral formula from Theorem [14] and prove that the resulting 
identity still holds. 

Recall the deformation h e z ■ He —> He, Z t— )■ Z + ie(Z — Zq)~ . First we deal with a 
technical issue arising from the fact that the image of U under h E: z does not lie inside Hj. 
Thus we modify the deformation h £> z as 

h^ Zo : H c -> H c , Z^Z + e(l + i)(Z-Z )-. 

Note that 

^* Zo (iV(Z-Zo)) = (iV(Z - Z ) + 2e5(Z - Z )) + 2ie(S(Z - Z ) + eX(Z - Z )), 
so, for |e| sufficiently small, the denominator of wgzjgpi is bounded away from zero on (h £j x )*(9U). 
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Lemma 33 Fix any Zq G He, then, for e > sufficiently small, h £: z (U) C Hj. 
Proof. Let Z = ( Zu Zl2 ) , Z = ( VU Vl2 ) and h E , Zo (Z) = ( Z \ l Z ')A . We can write 



221 ^22/ \2/21 2/22/ \ Z 21 z 22 

z 'n z ' 12 \ _ f (1 + e(l + i))z u (I - e(l + i))z 12 \ r-i , \ f 2/11 —2/12 



Z 21 Z ' 22 J \(1 - e(l + i))z 2 i (l + e{l + i))z 22 J ^ + % ' \~V2l V22 

Since \z\\\ > \z2i\ and \z2 2 \ > \ Z 12\ f° r all Z G U, by taking £ > sufficiently small we can 
arrange that 

|(l + e(l + *))zii| - |(l-e(l + i))z 2 i| > 2y/2e\ yij \, 
|(l + e(l + i))z22| - \ (l-e(l + i))z 12 \ > 2y/2e\ yij \. 
Then h £ ^z Q {Z) satisfies the inequalities \z' 21 \ < \z'n\ and \z' 12 \ < \z' 22 1- Finally, 

4i4 2 = ((1 + e(l + *))*n - £ (! + ((1 + e(l + *))Z22 - e(l + O1/22) 
= (1 + 2e)ziiz 22 + 2ze(l + e)ziiz 22 + 2ie 2 y n y 22 - e(l + + e(l + i))(2nj/22 + 2222/11)- 

The first term (1 + 2e)znZ22 is a positive real number, the second and the third terms 2ie(l + 
e)zuZ22 and 2ie 2 yny 22 are purely imaginary, finally the fourth term e(l + z)(l+e(l + i))(zny22 + 
Z222/11) becomes smaller in magnitude than (1 + 2e)zuz 22 when e > is sufficiently small. This 
proves Re^z'nZ^) > 0. □ 

Theorem 34 Suppose that f(Z) is a left-regular function on HjJ such that its components are 
bounded on closed sets 

Z=( ZU 212 W; C ^\ ZU/ ; 21 \^ E Z22 "!!^' M,M>U (28) 

\Z21 Z22) C < \Z22/Zi2\ < 2c, \Zi2/Z2l-l\<d, J 

for all c > 1 sufficiently close to 1 and some fixed values d, Lq > 0. Let Xq G HIr, i/ien /or e > 
sufficiently small 

1 /" (Z-Xq)- 1 n f/(X ) ifX €U; 



r (z-x ) Dz ^ 

J(h e . Xn UdU) N(Z-Xo) 



2k 2 J ( h e , Xo UdU) N(Z-Xo) [0 ifX Q £U. 

Proof. For L G R, let i?L denote the open ball {X G Hr; \\X\\ < L} of radius L, and set 
C7x = U D Bl. Clearly, the closure of Ul is compact, and the proof of Theorem 1141 shows that 
for L sufficiently large 



[ (Z-Xq)- 1 |-2^ 2 /(X ) ifXoGC/; 

l(Kx Udu L ) N(Z -X ) \o ifX t U. 



The support of 8Ul consists of a portion which lies in Hr\JHri and its complement. We define 
3- chains C\ and C\ by 

du L = cl + c 2 L 

with supports \C\\ C Hr U Hr> and \C 2 \ C Then 



L 



Dz-f(Z)= lim / ^ -Dz-f(Z). 
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Thus the theorem will follow if we can show 

lim /_ %- Xo) x 1 ) .D Z .f(Z) = 0. 

First we choose e small enough so that 

d 



l + e(l+i) 



l + e(l-») 
Then we choose a number c such that 

l + e(l + ») 



<2 



1 < c < 



< 2c. 



l-e(l + ») 

As L tends to infinity, the supports of C\ will lie inside the set (|28p . hence the components of f 
are bounded on |C£|. The volume of |C£| grows as O(L), the denominator of ^z-x\) 2 S rows 
as 0(L 4 ), and the numerator grows as O(L). This proves that the integral over C\ tends to 
zero. □ 



Remark 35 From l\20]) one can see that the matrix coefficients \1 3]) are bounded on the closed 
sets l\28\) as long as Re / < 0. 



3 The Discrete Series Component on Hr 
3.1 The Polynomial Algebra on 

Let us consider the matrix coefficients t l nm (Zys of the discrete series together with the limits 
of the discrete series. It is easy to see that they are rational functions in z\\, Z12, Z21, Z22, 
hence uniquely extend to Mq. In this subsection we identify certain spaces of rational functions 
spanned by these matrix coefficients. 

We think of the matrix coefficients t l nm (Z) and N(Z)~ 2l ~ 1 -t l nrn (Z) as meromorphic functions 
on He and introduce the following spaces: 

Vjucr = C-Pan of t^jZ) and N{Z T ^ • t^Z), m ^~^ _ z> 

(span of the matrix coefficients of the holomorphic discrete series), 

_ 1 

T>f im = C-span of t n m(Z), m,n eZ + 1/2, m,n> 1/2, 
(span of the matrix coefficients of the limit of the holomorphic discrete series), 

^ = C-s P an of ti m {Z) and N{Z)~^ ■ t^Z), ^ { 

(span of the matrix coefficients of the antiholomorphic discrete series), 

p zL = C - s P an of tni(Z), m,nGZ + l/2, m,n< -1/2, 
(span of the matrix coefficients of the limit of the antiholomorphic discrete series), 
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Note that the matrix entries Z\\ and Z22 are invertible on Hi. We denote by 

C[z u 1 ,Z 12 ,Z2l,Z 2 2]- C C[z{i, Zl<2,Z 2 l, Z22] 

the subalgebra of polynomials in Cf-z^ 1 , z± 2 , Z21, Z22] spanned by monomials z^ 1 ■ zf 2 2 • z^ 21 • z 22 
with du + c?i2 + c?2i + ^22 < 0. Similarly we can define a subalgebra 

C[z 11 ,z 12 ,Z2i,z 22 1 }- C C[zii,zri2,«2i,^ 2 1 ]- 

Let P< (respectively 2?> ) ^ e ^ ne C-span of t l nm (Z) (respectively t l nm (Z) ■ N(Z)~ 2l ~^) with 
Z = —5, —1, — §,..., m, n G Z + Z, m,n > —I. Then Z? - = 2?< + D> and 2?> is the image of 
"D< under the inversion map tp(Z) 1— )■ ZV(Z) -1 • ip(Z/N(Z)} . Similarly we can define £>< , P>q 
so that T> + = P< + 2?> and D> is the image of D< under the inversion map. 

Proposition 36 We have: 

V <0 = e Z^i ■ C[Zu, Z 1 2,Z21,Z 22 }- ; 2) 2tp = 0}, 

£>| = {99 G ^ • C[z n , z 12 , z 21 , z^]- ; n 2>2 (p = 0}. 

Remark 37 Note that T>~ is a proper subspace o/{^£ z^\ • C[z^ , Z\ 2 , Z21, z 22 \; 2j 2 <f = 0}, 
since the functions zf] 1 ■ zf 2 2 an d zf^ 1 • z^ 21 with du < 0, d\ 2 ,d 2 \ > —du are not in T>~ . 
Similarly, T> + is a proper subspace of jy? G z 22 • C[zn, z\2, Z21, z^ 1 ]; '—'2,295 = 0}. 



Proof. Recall the integral formula for matrix coefficients f j 1 3 j) . In the holomorphic case m,n> 
—I, we have Z + m > and 



on the other hand Z — m < and 



Substituting into (|13p we see that t l nm (Z) is the coefficient of s° in the expression 

E 



0<9<; + m 
r>0 



9 



Z + 171 \ I I m \ ;_ m _ r q r i+ m _q, n _ m +g_ 
' z ll ' z 12 ' z 21 ' z 22 ' 6 



Therefore, q = r + m — n and 

l+n 



t l nm (Z) = V ( ^ |+ ™ J . ( Z ^ j . . z r+m-n . ^ . ^n-r _ (2Q) 



r=max{0,n- m} 

Let djj denote the degree of Zij. Then all the monomials in t l nm (Z) have du + d\2 + ^21 + ^22 
21 < —1. This proves 

£>< C {(/? G z^ 1 • C^ 1 , 012,^21,^22]-°; □2,2V = 0}- 



It remains to prove the other inclusion. Observe that each t l nm (Z) is a finite linear combi- 
ion of monomials z^ 1 • zf 2 2 ■ z^f 1 ' z 22 2 w itli 

du + di2 = I - n, d 2 \ + cZ 22 = Z + n, du + d 2 i = I — m, d\ 2 + d 2 2 = Z + m. 
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These sums of degrees can be conveniently arranged in the following form: 

dn + dn I — n 

d\\ + d 2 \ du + d 2 2 = l — m l + m. 

d2i + d 2 2 l + n 

Each degree invariant 

dn + di 2 D\ 
du + cfei d 12 + d 22 = D 2 D 3 (30) 

d2i + d 2 2 At 

has an obvious restriction D\ + D4 = D2 + D3. These observations lead to the following lemma: 

Lemma 38 The matrix coefficients t l nm (Z) with m,n > —I produce all possible degree invari- 
ants A30\) satisfying D 3 , D4 > and D\ + D4 = D2 + D 3 < — 1. Moreover, the functions of the 
type t l nm (Z) can be uniquely recovered from their degree invariant. 

The degree invariants of z u , Z12, Z21, Z22 are respectively 

-110 
-1 0, 1, 1 0, 1. 

11 

Thus the monomials in z^ 1 ■ C[z^, Z12, Z21, Z22] automatically satisfy D 3 , D4 > 0. The operator 
□2,2 is homogeneous with respect to these invariants in the sense that it sends 

Dt Di - 1 

D 2 D 3 ^ D 2 -l D 3 -l. 

D A D4-I 

Thus it is enough to show that the space of harmonic polynomials in z^\ • , Zi 2 , z 2i, Z22] 

with a given degree invariant f)30|) is at most one-dimensional. Fix a degree invariant (J3Q]), then 
any function cp 6 z u l -Cfz^ 1 , 212, Z21, Z22] with that invariant must be a finite linear combination 
of 

Jh. . D 2 D 3 -D 1 (Zl2 £21 \ r _ r . D 1+ r _ D 2 +r _ D 3 -Di-r , D _ R 

z 12 z 21 z 22 I _ _ J — z ll z 12 z 21 z 22 > f — J., . . . , ^3 i^l- 

V^22 ^llV 



Thus 

£> 3 -£>i 



— r Di+r D 2 +r D^-Di—r 



Cl<p ' Z-\ i * o * Z>< 
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r=l 



We spell out the equation □2,2V = 0: 

= £ 1 a r • r(L> 3 - A - r) • atf" 1 " z u +r ■ 4 2+r • 4 3 ~ 0l ~ r_1 
r=l 

v Z>i+r-l _Z>2+r-l „D 3 — Dj— r 



r) ■ Z 1X ■ Z 12 ■ Z 21 ■ Z 22 



+ a r •(£>! + r)(L> 2 + 

r=l 

which gives us recursive equations 

(r-l)(D 3 -D 1 -r + l)-a r - 1 = -(D 1 + r)(D 2 + r)-a r , r = 1, . . . , D 3 - B x . (31) 

Hence the space of solutions in z^ 1 ■ Cfzj^ 1 , Z12, 221 j ^22] ~° is a t most one-dimensional. 
The case m, n < I is completely analogous. □ 
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3.2 The Action of s[(4, C) 

For convenience we restate Lemma 17 of |FLlj describing the nf and 7rJ? actions of 0t(4, < 
0[(2,Hc) on t ne spaces of harmonic functions 



7T? 



s 





C 



7T, 



7T„ 



7T; 



7T.,. 



A 



A 



B 





C 



D 



D 



ip^ -Tr(A- X ■ dip) 
ip^-Ti(A-(X -dip + ip)) 
ip \-> - Tr(B ■ dip) 

ip t-> Tv(c ■ (X ■ (dip) ■ X + Xip)) = Tr(c-(X- d(Xip)) - Xp 



ip Tr[D ■ ((dip) -X + p)) = Tr(D ■ (d(Xp) - ip 
ip t-> Tr(D • (dip) • X) = Tt(d • (d(Xip) - 2ip)), 



where d 



du d 2 i 



iV. Recall the representations T~L + and % of sl(2,Hc) realized in 



v ^12 <9 22 J 2 

the space of harmonic functions on EI (see Subsection 2.5 in [FLlJ). 

Theorem 39 We have V~ ~ %~ and V + ~ T~L + as representations of sl(4, C) = sl(2,Hc) C 

fll(2, Etc). Moreover, T>~ and T> + are irreducible representations o/st(4, C) with highest (or 

_i _ i 

lowest) weight vectors t 1 \ (Z) = jjj and t \ 1 (Z) = respectively. 

Proof. Using Lemmas 1171 and [T8l we can compute the Lie algebra actions irf and ir® of gl(2, H) 
on V~ and V + : 



TV, 



B 





C 



71",. 



7T„ 



7T? 



7T,. 



4 



4 



B 







C 



D 



D 



(l-n)t l nm (l-n + 1)4-1, 
(Z + n + l)4 +lm (l + n)4 m 



f I V 



Tr ^ f (l~n+ l)t l nm (l-n + 

n n 

/ f(l-m)t l ~\ 4 . 1 (i-m)M ,! 



m 



4 m ^"Tr \B- 



Z-A Z-± 
(Z + m)t ^ j (Z + m)t \ ! 



*nm ^ Tr C • 



4 m ^Tr D 



(i + n + l)* l4 A ! (i + n + lJt'H . 



v (* + m )4m-i (z + m + iyt^ m 

(l — m)t l nrR (I — Tn)t nm+1 \ ^ 



n m 



and similarly for t l nm (Z)-N(Z)~ 2l ~ 1, s. This together with equation (|14p shows that the ^-action 
of sl(2, He) preserves and that t 1 \(Z) and i \ - L (Z) generate T>~ and T> + respectively. 
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Let £3 = 163. Consider an element 
Then 

7r?( 7o ): 1 ^ J_ = -»rf 1 (^)€X)+ 

^-^22 2 21 

(This is essentially the composition of the Cayley transform from |FL1| with another Cayley-type 
transform which will be introduced in Proposition [58]) This proves Tf^ ~ "H^, irreducibility 
and the statement about the highest (or lowest) weight vectors. □ 

Representations D~ and T> + are dual to each other. Define a bilinear pairing between T>~ 
and T> + by declaring 

{$nfrrA.Z)i j\T(Z) ' ^ Tn ^ Z ^ V- xV+ = ( N(Z) ' ^ m *^ ^ ™L x£>+ = < ^'^ mm "^ m '' 

(tnm(Z)i t n ' m/_i^))x>~xT>+ = \ JVTZ) ' ^ m 'H.^ )' jy( ^) ' ^m' n/(Z ^)z)- xZ>+ = ^' 
/ = —1, — |, —2, .... In the second line we exclude I = —1/2 because by (j23| we have 

Ntf)- 1 -tnUZ- 1 ) =tZl = n(Z). 
By Proposition [31] this pairing partially agrees with the bilinear form (|24p up to a sign. 
Proposition 40 T/izs bilinear pairing on T>~ x T> + is qI(2,Mc) -invariant: 

(7rf(Z)<p 1 ,ip 2 ) v . xV+ + (viy r {Z)w) v - xV+ =0, yZ G 0l(2,Hc). 

Proof. Since the elements ^ "j^ € sl(2,Hc), -B G He together with their conjugates by 

J ^ G GL(2,Hc) generate s[(2,Hc), to prove s[(2, Hc)-invariance it is enough to check the 

invariance under the action of By Lemma 17 from [i FLl] . 

Applying Lemmas [T7] and [18] repeatedly we find that 

( - ™)t l ±Az) (i - m )t:\_jz) 



^ 




9ii #21 \ j 



0\2 U22, 



V + rnrfJiAZ) (l + m)t l -\AZ) 



K di2 d 22 



N(Z) 



({I 



N(Z) 



m + l)t + K 

' m—i 



m + l)t l+ K 



(l + m + l)t'l, dZ- 1 ) 



(l + m + l)t 



_2_ 

, (z- 1 ) 
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We conclude that the bilinear pairing is invariant under the action of ( ^ ^ ) . Using Lemma 



17 from |FL1] it is easy to see that the pairing is invariant under the scalar matrices as well, 
and the proposition follows. □ 

3.3 Ol'shanskii Semigroups 

We introduce complex Ol'shanskii semigroups T ± C GL(2,C) C He. Following |Kou0l and 
[HNJ, consider a Hermitian form H on C 2 defined by 

H(C,v) = -Qim + ^m- 

It is easy to check that if X G iu(l, 1), then H(X(,C) G R for all ( G C 2 . Consider a cone m 
iu(l, 1) defined by 

C = {X G iu(l, 1); fl"(XC, C) < 0, VC G C 2 }. 

Lemma 41 The cone C is closed, convex, pointed (i.e. C(~)—C = {0}), generating (i.e. C—C = 
iu(l, 1) or, equivalently, has non-empty interior), hyperbolic (i.e. for every X G C, the operator 
adX has real eigenvalues and, for every X in the interior of C, adX is diagonalizable) and 
Ad(U(l, 1)) -invariant. 

The set 

f- = [7(1, 1) • exp(C) 

is called a closed complex Ol'shanskii semigroup contained in GL(2,C). The interior of C is 

C° = {X G iu(l, 1); h pre, < o, VC G C 2 \ {0}}, 
and the corresponding open Ol'shanskii semigroup is 

T- = [7(1,1) -exptC ). 

The semigroup T~ is an open subset of GL(2, C) and hence of He- In fact, T~ is the interior of 
If we re-define for a moment the complex conjugation on He to be relative to Hr = u(l, 1) 
(i.e. by identifying He with u(l,l) © iu(l,l)), then the conjugate Ol'shanskii semigroup T~ 
coincides with f + = 17(1, 1) • exp(-C). Similarly, r= = T + = U(l, 1) • exp(-C°). 

Lemma 42 We have 

C={x=(®_ ; a, b G R, a, 0, 7 G C, |7| 2 < abj C iu(l, 1) 



C°=ix=( a _ 7 ) ; a, 6 G R, a, 6 > 0, 7 G C, | 7 | 2 < a6 [> C itt(l,l). 



and 

n°= I x = ( 

- 7 —by 

In particular, each X G C° /ias iwo distinct real eigenvalues - one positive and one negative. 

Fix a maximal compact subgroup U{1) x f7(l) of [7(1, 1); its complexification TTc consists 
of diagonal matrices, and every element in T - is SU(1, l)-conjugate to an element in 

r- n K C = I (q 1 "J; Ai,A 2 gC, |Ai|>1>|A 2 |>0 

Similarly, every element in r + is SU(1, l)-conjugate to an element in 

r+n# c = {Q) 1 A ° 2 ^); Ai,a 2 gC, |a 2 | > 1 > |Ai| > o y 
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Proposition 43 The Ol'shanskii semigroups T~ and T~ have the following crucial property: 
707 and 770 G T whenever 70 G T~ and 7 G T~ . 

In particular, if we let 

W£U+ and Z G • f J ' ^(l, X ) c M C, 

then WZ- 1 G r - for all 1 > a > and WZ' 1 G T+ for all a > 1. 

Lemma 44 ForW G r~ur + and Z G {7(1, 1), the function N (Z — W) is never zero. Moreover, 
if we fix W G r~ U r + , i/iere exzsi c > and e > depending on W such that 

1 c 

< 



iV(Z- W) - \\z\\ 

for all Z G H R mii/i 1 - e < JV(Z) < 1 + e. 

Proof. For concreteness, let us suppose W G T~; the other case is similar. We rewrite iV(Z — W) 
as N(Z~ 1 W — 1) • N(Z). Then Z~ l W G T~ and hence has eigenvalues different from 1. 
Therefore, N{Z~ l W - 1) / 0. 

If Z G H M , then iV(Z - W) = N(Z) ■ N{Z~ 1 W - 1). Every element W G T~ is S"[/(l, 1)- 

conjugate to a diagonal matrix ( 1 J with Ai,A2 G C and |Ai| > 1 > |A 2 | > 0. Since the 

V A 2 / 

determinant function is .AcZ(5'{7(i, l))-invariant, without loss of generality we may assume that 

w - ( o I) The " 



det 



zTT -z 12 \ ( Ai \ _ A 
-*l2 211 M A 2 i V 1 



det 



Aizn - 1 -A2212 
-\\zE \iz\\ - 1 



(AizTT - l)(A 2 zn - 1) - AiA 2 |zi 2 r = A x A 2 iV(Z) + 1 - (Aizil + \ 2 z n ). 



Now the term AiA 2 A^(Z) + 1 stays bounded while HAi^n + A 2 zn|| grows proportionally to ||Z|| 
as Z — > 00. □ 

As we saw in Subsection 13. 1[ the matrix coefficients of the discrete series and their limits are 
rational functions in Zij's. More precisely, the matrix coefficients of the holomorphic discrete 
series and its limit lie in C[zn, Z12, Z21, z 22 , z^]. Hence they extend uniquely as holomorphic 
functions to the open set {Z G He; £11 7^ 0}. On the other hand, Lemma 2.6 from |Kou0] 
implies that T~ C {Z G He; 211 7^ 0}. In particular, the matrix coefficients of the holomorphic 
discrete series and its limit extend holomorphically to T~ . Similarly, the matrix coefficients of 
the antiholomorphic discrete series and its limit lie in C[zn, zi 2 , z 2 i, z 22 , z^ 1 ]) extend holomor- 
phically to the open set {Z G He; z 22 7^ 0}. Since T + C {Z G He; z 22 7^ 0}, these coefficients 
extend to T + . 

3.4 Matrix coefficient expansions for N ^-w) an< ^ ^mz^-w) 

In this subsection we derive matrix coefficient expansions for N ^ z _ w -^ an d jv(Z-VV) ' Using these 
expansions we obtain projectors onto the discrete series components for the spaces of solutions 
of □22V? = and left- and right-regular functions on Hjt. 
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Proposition 45 We have the following matrix coefficient expansions 

~ N(Z-W) = ^ ^nm ( W ) ■ Jf(z)- Cni 2 ' 1 ) + Yl WW) ' ^nrniW- 1 ) • 4n(^) 

L,m,n l,m,n 
m,n>-!>l m,ri<i<-l/2 

which converges pointwise absolutely whenever W Z~ l £ F~ and 

~N(Z-W) = ^ ^JW) ■ J^z ■ t l mrk {Z- X ) + J^F) ■ tlrni^y tl rnn( Z ) 

m,n<i<-l m,ri>-i>l/2 

which converges pointwise absolutely whenever WZ~ l G T + . 
Remark 46 From \2'J\) we have 



N{W)- 1 ■ tnKW- 1 ) ■ t m l{Z) = t_l l= JW) ■ t n l(Z) = tJ^_JW) ■ iV(Z)- 1 • U^" 1 )' 

Hence, in each expansion of N ^-W) ' ^ he ^ erms corresponding to the limits of the discrete series 
(terms with I = —1/2) can be included in either the first or the second sum. 



Proof. Since every element in T is SU(1, l)-conjugate to an element in T n Kq, to prove the 

Ai N 
A 2y 



first expansion we can assume that WZ 1 £ 1 n Kc, and so WZ 1 = ( ^ ) for some 



Ai,A2 £ C with |Ai| > 1 > IA2I > 0. The discrete series characters are: 



\2l+l \ \-2l 



o+iwz- 1 ) = — — ^ — — , Q+(ZW 



Ai — A2 Ai — A2 

x2Z+l \ \-2l 

Q i (WZ- l ) = -^—, Q 7 (ZW- 1 ) = -^-^-. (33) 

Ai — A2 Ai — A2 

Using the multiplicativity property of matrix coefficients 

tnm( Z l Z 2) = /J l nk( Z l) " Ami^), (34) 
the expansion reduces to a geometric series computation: 

l,m,n ' I ,m,n ^ ' 

m,n>— Z>1 m,n<Z< — 1/2 

= • ( E + a/(^- x ) • £ 

n>-!>l n<i<-l/2 

^ ' \<-l K-l/2 ' 

" N(Z) ' Ai - A 2 + ^ Ai - A 2 )~ N(Z) ' X, - A 2 ' \\i - 1 + 1 - A 2 

11 11 1 



N(Z) (Ai - 1)(A 2 - 1) N(Z) N{WZ- 1 - 1) N(Z - W) ' 
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The other matrix coefficient expansion is proved in the same way. □ 
For R > 0, define operators on H(Mi) by 

By Lemma [44] these integrals are well defined. From the orthogonality relations for matrix 
coefficients (Proposition 13 1 [) we obtain: 

Theorem 47 The operators and are continuous linear operators %(Hjt) — > 7^(ElJ). 
T/ie operator annihilates the continuous series, the antiholomorphic discrete series T>% scr 
and sends 

CJX) ^ -ti m {W)-RW)-N{W)-^-ti m (Wl 1 = -1-1-2,..., 

m,n € Z + I, 

N(X)- 21 - 1 ■ t l nm (X) ^ R-W) . t i n jw) + N{W)- 21 - 1 ■ t l n jW), m,n> -I. 

The operator S^> annihilates the continuous series, the holomorphic discrete series T)~7. and 
sends 

t l nm (X) ^ -tl m {W)-RW)-N{W)-^-ti m (W), l = -l-l- 2 ,..., 

m,n € Z + I, 

N(X)-*-i.t l nm (X) ^ R-W).t l n ^(W) + N(Wy^-ti ni!1 (W), m,n<l. ' 

Note that the closure of R • T~ is R • F which contains Hr. Also, the functions t nm (W) 
and R 2( ~ 2l+l ) ■ N(W)~ 2l ~ l ■ t l nm (W) agree on Hr. Thus, the values of the holomorphic discrete 
series component of a function tp 6 %(Ku) on Hr can be determined by continuity. Similarly, 
one can recover the antiholomorphic discrete series component of <p on Hr. 

Differentiating the matrix coefficient expansions for n^z-W) we ^ wo ex P ans i° ns f° r 
(z-w)- 1 . 

N(Z-W) ' 

Proposition 48 We have the following matrix coefficient expansions: 
(Z - W)- 1 _ ^ 1 f(l-n + l)t l n _ lm (W- l T 



N(Z-W) 

x ' l,m,n 



V _J_ f(l-n+ Wn-t^W- 1 )} f l-l l-\ \ 

^ N(W){ {l + n)t l n jW' 1 ) jlWi«4^'Vi^J 



m,n<(<-l/2 

4 



I , m , n 
m,n> — Z> 1 



which converges pointwise absolutely whenever WZ £ T anc? 

(^-^T 1 V- _J_( (l-n)t l nrn (W- 1 ) z-i 



Z ,m,n 

m,n>— (>1/ 2 



2 1 2 2 1 2 



m,n<Z < — 1 



which converges pointwise absolutely whenever WZ 1 £ T + . 
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Proof. The two expansions are proved by applying V z to the expansions in Proposition [45] 
where the subscript Z in V z indicates that the differentiation is done with respect to this 
variable. We give a proof of the second formula 



1 



1 



(z-wr 1 = i 

N(Z-W)~ 2 Z N(Z-W) N(W) 



l,m,n f 

m,n'>—l>l/2 



On d 2 \ 
d\2 Q22 



l,rn,n 
m'n<K-l 



(35) 



Using the derivative formulas from Lemma [PT1 we can expand the first sum in H35 [) as: 

f(l-n')t~K , AZ) (l-n')t~K , JZ) 



E 4u^ _1 ) 



i ,m,7i f 
i,n'>~l>l/2 



E 



i ,m,n 
i,n'>-l>l/2 



~ n>)tl,jW^) ■ Cl^Z) (I - n>)t,jW^) ■ tl^Z) ' 
(* + n')t l n> jW^) ■ n ,_ h (Z) (I + n')t l n ,jW-') ■ t l ~\ n ,_ h (Z) 



Replacing n' with n + 1 in the second row we get: 



E 

l,m,n , 

t,n>-Z>l/2 \ 



(l + n + l)t l n+1 jW-') ■ t l JI n+ i (Z) (l + n + l)t l n+lm (W-l) ■ t l J~ n+1 _ (Z) 



E 



l ,771, n 
m,n> — Z>l/2 



(I - n^jW- 1 ) 
(l + n+lK^W- 1 ] 



Similarly, we can expand the second sum in H35 [) using the derivative formulas from Lemmas 
[TTJ and the multiplication identities from Lemma [181 El 

From Lemma [44] and Proposition [32] we obtain: 



Theorem 49 For each left-regular function f G S(Hjt) and R> 0, the integral 



1 



(X- PT) 



-1 



2^ 2 7x e ^ - W) 



■Dx-f(X), 



w g -R • (r~ u r + ), 



converges. 

Let Pq anc? P^, 6e the projections onto the holomorphic discrete components quasi-regular 
at the origin and infinity respectively. Similarly, let Pq and P+ be the projections onto the 
antiholomorphic discrete components quasi-regular at the origin and infinity respectively. This 
integral gives 



and 



(P ~(/)-Poo(/))W ifWeR-T- 
(Pj(/)-P+(/))(W0 ifW£R-T + . 



Similar statement holds for right-regular functions g G § / (H + ^ 
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3.5 The Discrete Series Projector 

Recall that in Theorems [47] and [49] integration takes place over X £ H R and the variable W 
lies in R ■ T~ or R ■ T + . But Hr n R ■ (T~ U T + ) = 0. In this subsection we deform the contour 
of integration so that the resulting integrals still provide projections onto the holomorphic and 
antiholomorphic discrete series components, but W will lie in open regions containing H R . In 
particular, these regions will have non-empty intersection with Hr. 
Observe that, for any a > 0, the sets 

^i)-^ and e m-(o J*-i) He inside H+ 
We introduce cycles in 

c^=(o a -x)- H * and c' R , a =H R .^ Q a ty 

If a > 1 these cycles lie in R ■ T~ , and if < a < 1 these cycles lie in R ■ T + . In other words, 
the sets 

R ■ ^ ■ and R ■ T~ ■ \ Z J^-i^j contain H R when < a < 1, 

R - 1 I ■ r + and • r + • f ^ 1 | contain .Hp when a > 1. 

Theorem 50 For each R,o~ > 0, we have well defined continuous linear operators S^, and 

(s »^ )W= -i/«,,l^)' fe)(z> ' ,V6K -(o A) rT > 

R,<T 



Operators S Ra and S Ra annihilate the continuous series, the antiholomorphic discrete series 



discr 

t l nm (Z) ^ -t l n jW) - RW+V ■ NiWr 21 ' 1 ■ t l n jW), I = -1, -§, -2,..., 

m, n £ Z + I, 

N(Z)- 21 - 1 ■ t l nm (Z) ^ R-*W+» . t l nm (W) + N(Wy 2l ~ l ■ t l nm (W), m,n> -I. 

Operators S^, and S Ra annihilate the continuous series, the holomorphic discrete series T^7i scr 
and send 

t l nm (Z) ^ ~t l n jW) - R 2 ^ ■ N{W)- 21 - 1 ■ t l n!R (W), I = -I, -§, -2,..., 

m, n £ Z + /, 

N(Z)- 2l ^-t l nm (Z) ^ R~W).t^(W) + N{W)- 2l - l -t l nm (W\ m,n<l. ' 

Proof. From Proposition 11 of |FL1] we see that the differential form Z^ 1 -Dz is invariant under 

f a \ 



the map Z i— > ^ X J Z. Similarly, Dz ■ Z 1 is invariant under the map Z i— >• Z 



a 



-l 
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LetZ=( a l °W W=( a f . 1 ° ) W, and define Cp by <p(Z) = <p(Z). Using jl3| and fl22 



x o o-y ' V a 

one can show 

which implies that the map ip i— > ^ preserves the holomorphic discrete series, antiholomorphic 
discrete series and continuous components of / H(M^). We have: 

and similarly for S^. Then the result follows from Theorem l47l □ 

Now we redo this for left- and right-regular functions. The same argument that was used to 
prove Theorem 1501 also proves: 

Theorem 51 For each left-regular function f G S(lljjt) we have: 



^LJ^^- Dz - f{z) =\ 



a-\ 

(P + (/)-P+(/))(W) ifWeR-l* ff ° 1 )- rH 



Similarly, for each right-regular function g G S'(Hi') we Ziawe: 

(p -( 5 )-p-( 5 ))(^) i/WGJ2-r- 



^ 2 JzeC' a<7 " ' N(Z-W) 



(P+(g)-P+(9))(W) ifW£R-T A 



a 

a- 1 

a 

a- 1 



3.6 Second Order Pole in H K 

We consider the linear span of the functions t l nm (Z) ■ N(Z) k over 

I = -1,-3/2,-2,... , m,neZ + l, m,n>-l, < k < -21 - 2 

and over 

I = -1,-3/2,-2, ... , m,neZ + Z, m,n<l, < k < -21 - 2. 
We denote the first span by D and the second one by T> ++ . It is easy to check that 

T> £ % 2 • C^ 1 , Zl2, Z 21 ,Z22]- C C[z^,Zl2, Z 21 ,Z 22 ] 

and 

P ++ C Z^ 2 • C^u,^,^!,^ 1 ]- C C[z 11 ,Z 12 ,Z2l,Z 22 1 }. 

We have the following analogue of Proposition 19 in |FL1] : 

Proposition 52 Let T><q (respectively F)Z^ ) denote the span of t l nm (Z) ■ N(Z) k with I = 
— 1,— §,-•-, m, n 6 Z + /, m, n > — Z, < k < — Z (respectively —l<k< —21 — 2). Then 
T>~~ = TJ^q + T>^q , where T>>q is the image of T><q under the inversion map F{Z) \- > 
N(Z)- 2 ■ F(Z/N(Z)) and 

V <0 = Z ll ' C fol\ Z 12) z 21, Z 22 }-°. 

Similar statement holds for T> ++ . 
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Recall an action p\ of GL(2,Hc) on the space of functions on He with singularities defined 
in [FLT] by 

, . \ / \ F((aZ + b)(cZ + CI)- 1 ) 

a' b'\ , _i fa b 



h ={<t d>)> h ' ={c d )^ GL ^ 

Differentiating, we obtain an action of gl(2,Hc) ~ gl(4, C) also denoted by pi; this action was 
described in Lemma 68 in |FL1] , Recall the representations )fC~ and }fC of s[(2,EIc) introduced 
in (FLT] . 

Theorem 53 We have V ~ }fC and T> ++ ~ /K^ as representations o/g[(4, C). Moreover, 
T>~~ andT> ++ are irreducible representations o/sl(4, C) with highest (or lowest) weight vectors 
t^l(Z) = z^l and tz\_i(Z) = respectively. 

Proof. The proof proceeds in the same way as that of Theorem |39j First, we check using Lemma 
68 in [FLT] and Lemmas [HI US that the spaces T> and T> ++ are invariant under the p\ action 
and that t~z\(Z) and tz\_i(Z) generate T> and T> ++ respectively. Recall the element 70 from 
(1321 . Then" _ 

M7o): ^91 ^ z^ 2 = tz\_ 1 (Z)GV ++ , 
^ 3 W{Z) ^ ^i=til(Z)€V-. 

This proves D^T ~ irreducibility and the statement about the highest (or lowest) weight 
vectors. □ 

Next we establish two expansions for jqrz-WJ 2 • 
Proposition 54 We have the following matrix coefficient expansions 

N{z __ w) 2 = E "( 2/ + rfnmiW) ■ N{W) k ■ tl^Z- 1 ) ■ N(Z)- 



k-2 



k, I, m, n 
m, 71 > — I > 1 
< k < -21 - 2 



which converges pointwise absolutely whenever WZ 1 6 T and 
1 



N(Z - W) 



2 

k, I, m, n 
m, n < I < —1 
< k < -21 - 2 



£ -(21 + l)t l nm (W) ■ NiWf ■ tl^Z' 1 ) ■ N(zy 



k-2 



which converges pointwise absolutely whenever WZ £ T + . 

Remark 55 Note that, unlike the expansions of N ^z-w) 9^ ven ^ n Proposition 45 the matrix 
coefficients of the limits of the discrete series do not enter the expansions of w^rppp • 

Proof. The proof is similar to that of Proposition |45] Thus we can assume W Z~ l G T~ n Kc, 

-1 _Ai o 



and so WZ' 1 = ( q a J for some A i> A 2 G C with |Ai| > 1 > |A 2 | > 0. Using ([33]) and jM 
and letting indices k, I, m, n run over 

1<-1, m,n>-l, < < — 2Z — 2, 
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we obtain: 

-fc-2 



(2/ + l)t l n JW) ■ N{W) k ■ tl^z- 1 ) ■ N(zy 

,l,m,n 

— ^ £(2Z + l)tUwZ- 1 ) ■ N{WZ- l ) k = E( 2Z + mHWZ- 1 ) ■ N(WZ~y 

^ ' k,l,n ^ ' k,l 

21+1 i \22+l \-2Z-l 



1 nt-,~, Af +i „ . s , 1 _ Af +i -A 



2 



iV(Z)2^^ Ai — A 2 iV(Z)2^^ (Ai — A 2 )(l — AiA 2 ) 

11 1 1 



N(Z) 2 (1 - Ai) 2 (l - A 2 ) 2 " N(Z) 2 ■ N(l - WZ- 1 ) 2 ~ N(Z - W) 2 ' 
The other matrix coefficient expansion is proved in the same way. □ 

Let e 3 = ie 3 = G He. We realize the group [7(2,2) as the subgroup of elements 



of GL(2,Hc) preserving the Hermitian form on C given by the 4x4 matrix . 
Explicitly, 

C / , \ a*e 3 a = e 3 + c*^^ 

f/(2,2) = ' J;a,&,c,(ieH C) d*e 3 d = e 3 + 6*e 3 6 I 
' a*e 3 6 = c*e 3 d J 

^ ,n 0*650 = 65 + 6*656^ 

; a,b,c,d G H c , d*e 3 d = e 3 + c*e 3 c >. 



c d 



ae 3 c* = 6e 3 d* 



The Lie algebra of [7(2, 2) is 



u(2,2) = I (e 3 B*e 3 d) ; A-B.-DeHc, e 3 A = -(e 3 A)* ,e 3 D = -(e 3 D) 

If ^ G 17(2,2), then f° ^ = e 3 (_°*, e 3 . The group [7(2,2) acts on H c by 

conformal transformations preserving [7(1, 1), where we identify [7(1, 1) with a subset of He: 

U(1,1) = {Z eMc; Z*e 3 Z = e 3 }. (36) 

We orient [7(1, 1) so that {eo, Si, e 2 , e 3 } is a positive basis of the tangent space at 1 G [7(1, 1). 
We have a symmetric bilinear pairing on D © T> ++ : 



(F 1 ,F 2 ) 1 = -^[ F 1 {Z)-F 2 (Z)dV 
27T JU(l.l) 



'£7(1,1) 

(recall that dV = dz° Adz 1 Adz 2 Adz 3 is a holomorphic 4-form on He). This pairing is gl(2, ] 
invariant, which follows immediately from Lemma 61 in [FLl] and dZ A = dz\\ A dz\i A dzi\ A 
dz22 = 4aV. Related to this bilinear pairing we have a u(2, 2)-invariant inner product that is 
nondegenerate on T> and T> ++ : 

(Checking the u(2, 2)-invariance requires some verification.) 
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Every element in U(l, 1) can be uniquely written as e %e ■ Z with Z G SU(1, 1) and 6 G [0, ir). 
Thus we can identify 17(1, 1) with [0, vr) x SU(1, 1) and dV/N(Z) 2 restricted to U(l, 1) becomes 
id6 A Dz ■ Z~ l (since both sides express a f7(l, l)-invariant volume form and coincide at 1). 
From Proposition [31] we immediately obtain: 

Proposition 56 We have the following orthogonality relations: 

(C^Z) ■ Nizf^Z- 1 ) ■ N(Z)- k - 2 ) 1 = --L-5 kk ,5 u/ 5 mm ,5 nn ,, 

where the indices k, I, m, n are I = —1, — |, —2, . . . , m, n G Z + I, m,n > —I or m,n < I, k G Z 
and similarly for k' ,1' ,m' ,n' . 

From these orthogonality relations and expansions for j^^z-W)' 2 we °btain a formula similar 
to Proposition 73 in [FLl]: 

Theorem 57 Let P and P ++ denote the projections of T> © T> ++ onto T> and T> ++ 
respectively. For each function F G T> © D ++ and R > 0, 



2^ 3 JzeRU(i,i) N(Z - Wf \(P++F)(W) ifWeR-T+. 

In particular, the integral converges absolutely for W G R ■ (T~ U r + ). 

4 Separation of the Series for SL(2, C) /SU(1, 1) 
4.1 The Cayley Transform between Hr and M 

Recall that £3 = ie% = ( ^ J G He and that f7(l, 1) is identified with a subset of He via 



J36J). 

Proposition 58 Consider an element 

TVie fractional linear map on He 

7^(7) : Z^esZ + lX^Z-ir 1 

maps M —7- f7(l, 1) C He (with singularities) and sends the unit one-sheeted hyperboloid H 
{Y G M; N(Y) = 1} into £77(1, 1) = {X G H K ; iV(X) = 1}. The singularities 0/717(7) on ! 
& along the one-sheeted hyperboloid {Y G M; iV(y) = 1, Re(e3Y) = 0}. 
Conversely, the fractional linear map on He 



vr/^- 1 ) : Z^e 3 (Z + i)(Z 



-1 



maps £7(1, 1) — ?■ M (with singularities) and sends SU(1, 1) into the hyperboloid H The singular- 
ities of tti(^ 1 ) on Hr lie along the two-sheeted hyperboloid {X G SU(1, 1); ReX = 0}. 
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The map 7T; (7) and its inverse were studied in [Kou0] , we think of these maps as quaternionic 

ai± G M 

2/21 V22j 

and X = i{e 3 Y + l)(e 3 Y - 1)"\ then N(e 3 Y - 1) = 1 - N{Y) + y 22 - y n and 

x = ~i ( 1 + N(Y) + y u + y 22 2y 12 

N(e 3 Y - 1) V - 2 2/21 1 + iV(y ) - yn - y 22 / 

(37) 



AT(e 3 r - 1) V -2/21 1 - 2/u 

We orient the hyperboloid If C M as the boundary of the open set {Y G M; N(Y) < 1} and 
denote by sign 3 (Y) the sign of the ?/ 3 -coordinate of Y = y°e~o + y 1 e\ + y 2 e 2 + y s e 3 G M. 

Lemma 59 The restriction of 717(7) to H ^ SU(1,1) preserves the orientations for {Y G 
H; sign 3 (Y) > 0} and reverses the orientations for {Y G H; sign 3 (Y) < 0}. 

Conversely, the restriction of iri{~f~ l ) to SU(1, 1) — > H preserves the orientations for {X G 
SU(1, 1); ReX < 0} and reverses the orientations for {X G SU(1, 1); KeX > 0}. 

Theorem 60 For any ipi(X), ip 2 (X) G H(M™) that extend holomorphically to an open neigh- 
borhood of SU(1, 1) in He we have: 



(Vi> P2) = -«-2 / (deg X ¥>l)( X ) • ¥>2p0 

27r Jxesua.i) 



ixesu(i,i) 

= ^2 J Og^On • (d^g y (7r?(7Vi))0n • (vr?(7)^2)(y) 

where 

(7r°( 7 )^)(y) = jy^" 2 , 1} • <Pj{ifa Y + !)( g 3^ " l)^ 1 ), 3 = 1,2. 

Proof. The main ingredient of the proof is the following lemma which is obtained by direct 
computation. 

Lemma 61 For Y £i c and X = i(e 3 Y + l)(e 3 Y - l)" 1 G 517(1, 1) we have: 



N(e 3 Y-l) 2 y &A1 ^ V ' N(e 3 Y-l) 2 

Writing X = i(e 3 Y + l)(e 3 Y — 1) , dS'/||l r || = iDy/Y on H and using Lemma 10 together 
with Proposition 11 from |FL1| . we can rewrite 



a q r n r 

(deg x(pi )(X) ■ tp 2 (X) _ = - / (deg x v?i)P0 • - y- • 

r(l,l) ll A ll JX<=SU(1,1) A 

- 8 si g n 3 (y) ■ (55. V „,(X) ■ 1^ • „ • • ■ , 2 (X) 

.W ^ 31 ' ^V^feY-l) nV A ; V iV(e 3 r - 1) ||Y || 

= i / sign 3 (Y) • (d^g y (7^(7)^1)) (Y) • (*?( 7 )*2)(y) t^t 
JKeH ll r II 



□ 
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4.2 The Continuous Series Projector on M 

Recall that T>~ and T> + are irreducible representations of sl(4, C) with highest (or lowest) weight 

_ i _i 

vectors t 1 \(Z) = j— and t \ x (Z) = — respectively (Theorem I39[) . From ([37} we can see 

2_2_ 11 ~ 2 ~ 2 22 

that 

These functions have singularities along the set {Y G M; N(Y) = —1, ReY = 0} which has 
codimension 2. It is easy to see that they define a tempered distribution on M, and so their 
Fourier transforms are L 2 -functions on the light cone in the space dual to M. The space of 
functions on M that arise as Fourier transforms of the L 2 -functions on the light cone is known 
as the continuous series component of M. This proves that the Cayley transform switches the 
discrete series component on Hr and the continuous series component on M. 

To describe the images of F~ and T + under the Cayley transform 717 (7 -1 ) we recall the 
generalized upper and lower half-planes introduced in Section 3.5 in |FLlj : 

TT = {Z = Wi + iW 2 G H c ; W\ , W 2 G M, iW 2 is positive definite}, 
T+ = {Z = Wi + iW 2 G M c ; W\,W 2 G M, iW 2 is negative definite}. 

In the context of our paper, Lemma 1.1 in [Kou0 can be restated as follows. 

Lemma 62 The Cayley transform 7T/(7~ 1 ) sends T~ and T + biholomorphically into respectively 
Tq and Tq, where 

T ={Z N{Z-e 3 )^0} and T+ = {Z G T+; N(Z - e 3 ) ^ 0}. 

Recall that H is the unit hyperboloid of one sheet in M, and let T~L(H) denote the space of 
holomorphic functions <p defined on some connected open neighborhood U v of H in He which 
can be written as (f(Z) = (^(7)^) (Z) for some (p G H(M.^) and Z G Pi 17(1,1). Clearly, 

functions in H(H) are harmonic. We define operators on T-L(H) by 



f-s- Vy , if ■ (v , (degy)(y) dS 



rc+ 1 f ■ tv\ ( de g^(^) dS 

( D ID ) ( Z ) = x / Slgnq (Y ) ■ ; r T, u , Z G Jin • 

V ^ V ; 2tt 2 Jych N(Y-Z)\\Y\\' 



Theorem 63 Let ip G %{H), then S^ip are well defined functions on T n and Tq respectively. 
The operator S annihilates the discrete series on M, i/ie image of the antiholomorphic discrete 



series and sends 



(7T?(7)(iV(y)- 2i - 1 -tL I n))(n -> (7r?( 7 )(4, IS + JV(Z)- 2l - 1 .t , n2i ))(Z) J 

I = — 1, — 3/2, — 2, . . . , m,n£Z|l, m,n>—l. 

The operator S + annihilates the discrete series on M ; f/ie image of the holomorphic discrete 
series T>7 iscr and sends 

{^(l)t l n ^)(Y) ^ -{^{^{ti^ + NiZ)- 21 - 1 .t l nm ))(Z), 

(nf( 7 )(N(Y)- 2l ^.t l nm ))(Y) ^ (7r°(7)(4 m + ^(^- 2W -4m))(^), 

I = — 1, — 3/2, — 2, . . . , m,n£'Z-\-l, m,n<l. 
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Proof. Let X = i(e 3 Y + l)(e 3 Y - l) -1 , Z' = i(e 3 Z + l)(e 3 Z - l) -1 , and write p(Y") = 
(t^I { r y)<p) (Y) f° r some analytic ^ G H(Mg). By Lemma 10 from |FL1] . 

By Theorem 1601 we have 



(s T ^)(z) = —J sign 3 (y) • (d ^ )(y) #^ 

" vr2Ar(e 3 Z - 1) J XeSU{1>1) N(X - Z>) \\X\\ N(e 3 Z - 1) 1 1 m h 

Then the result follows from Theorem 1471 and Lemma [62] □ 

Note that, for Z G M and s G R, we have Z + se G T~ if s > and Z + se G T+ if s < 0. 
Moreover, Z + seo G Tq~ U if |s| is sufficiently small. Taking limits s — > ± we obtain: 

Corollary 64 Let Z G M and Zef 1" range over H, write Y = te~o + y 1 e\ + y 2 e2 + y 3 e 3 , 
Z = te~o + z e\ + z 2 e2 + z 3 e 3) then the operator on 'H(H) 



<p(Y) i y lim A / sign 3 (Y) 

e^0+ 27T Z Vy e # 



iV(y-Z) + iesign(t-t) ||Y| 



annihilates the discrete series on M ; i/ie image of the antiholomorphic discrete series T^X and 
sends 

(7r°( 7 )0(Y) -(^^){t l nm + N(Z)- 2l -'.t l nm ))(Z), 

(nf^iNiYy 21 - 1 .^))^) ^ (^(^(t^ + NiZr^.tl^iZ), 

I = — 1, — 3/2, — 2, . . . , m,n£2 + I, m,n>—l. 
Similarly, the operator on H(H) 

i f , (degtp)(Y) dS 



tp(Y) ■-> lim -^2 / _ signs ( y ) ■ 



N(Y-Z) -zesign(t-t) ||Y| 



annihilates the discrete series on M, i/ie image of the holomorphic discrete series T> di and 
sends 

^l(l)t l n m )(Y) ^ -{nf( 1 )(t l nm + N(Z)- 21 - 1 .t l nm ))(Z), 
(nf( 7 )(N(Y)- 2l - l .t l nEk ))(Y) ^ ^{l){t l nm + N{Z)- 2l ~ l .t l nr!k )){Z), 

I = — 1, — 3/2, — 2, . . . , m,)i6Z + !, m,n<l. 

Next we redo this for left-regular functions. We denote by S(i?) the space of holomorphic 
left-regular S-valued functions / that are defined on some connected open neighborhood Uf of 
H in M c and can be written as f(Z) = (71-/(7)/) (Z) for some / G §(11+) and ZeUfH U(l, 1). 
Similarly we can define the space of right-regular functions S'(H). 
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Theorem 65 For each left-regular function f G B(H) we have 

where P , denote the projections onto the 71^(7) -images of the holomorphic discrete compo- 
nents o/S(H^) quasi-regular at the origin and infinity respectively, and ~P$, P^, are the projec- 
tions onto the ti 7(7) -images of the antiholomorphic discrete components o/S(EI]^) quasi-regular 
at the origin and infinity respectively. 

Proof. Changing the variables Y = e~z{X + i)(X — i) , Z = e%{Z' + i)(Z' — i) , and using 
Lemma 10 with Proposition 11 from |FL1] . 

JV(Z'-i)- 1 J KSUM N(X - Z') N(X-i) n 3K ' ' 

= -2^(pf(/) - eUf))(h(z' + i)(z' - i)- 1 ) = 2^(p^(/) - pj(/))(z) 

by Theorem 1491 □ 

4.3 Basis of Harmonic Functions on M 

Writing the Minkowski space M as 

Y = y°e + ^e 1+ y 2 e 2 + y% = ("^i^ I^o'^) J l/V.vW 6 

we can embed M 3 into M so that (x^x^x 3 ) <~^> x 1 ei + x 2 e 2 + x 3 e3. Note that, for Y = 
te + x l ei + x 2 e 2 + x 3 e 3 G M, iV(y) = r 2 - £ 2 , where r = (x 1 ) 2 + (x 2 ) 2 + (x 3 ) 2 . We 
parameterize the unit hyperboloid H as 

x 1 = cosh p sin cos 93 —00 < p < 00 
x 2 = cosh p sin 9 sin 99 < tp < 2ir 

X 3 = COSh p COS # < 9 < 7T 

i = sinh p 

Lemma 66 We have the following SO(3, l)-invariant measure on the hyperboloid H : 

dx 1 Adx 2 Adx 3 l2 . „ , , ,„ _ , dS 

- cosh p sm 9 dp A dtp A d9 = iDy ■ Y 



(38) 



t r " \Y\ 

(H is oriented as the boundary of {Y G M; N(Y) < 1}). 

The functions (1 64ft can be regarded as functions on M + = {Y G M; N(Y) > 0}, and they 
satisfy Ds^v? = 0. From (|60p and (|62p by direct computation we obtain: 

Lemma 67 We have the following two families of solutions of n\s t i(p = on M + : 
(r 2 -t 2 ) 1 -r- l ~ x -^(9,^), 1 = 0,1,2,..., -I < m < I, 

of homogeneity degree I — 1 and 

(r 2 -t 2 )- 1 - 1 -r l ■Y l m (9,ip), 1 = 0,1,2,..., -I < m < I, 

of homogeneity degree —I — 2. 
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To construct a basis of solutions of CI3 iy> = we differentiate these two families with respect 
to t: 

^( r 2 _ t 2y . r -l-l . yn^ v) and ^ (r 2 _ ^-J-l . r l . jrm (6>j ^ (39) 

where I = 0,1,2, ... , —l<m<l,0<k<2l. We will see soon that these are two orthogonal 
families of functions on M + . Let T = t/r, then we can rewrite the first family in f)39[) as 

d k 



< 1 _ I a\l 



^■r^-Yne,?). 



dT k 

Then we rewrite this expression using the associated Legendre functions: 

{ - 2)l w^ky. ■ ^ • (r2 - t2)[l ~ k)/2 ■ p t k) m ■ *™ 



Same can be done with the second family in (139p . 

Theorem 68 We have two families of solutions of □31^ = on 



tim,n(Y) = ^ ^V+ n)! ' r " ' ^ " t2)n/2 ' P ' n)(t/r) ' "™ ^ (40) 

and 

fZmjy) = )j i2l+ ^ ) 7 n)l ■ r ~ l ■ ^ ~ ^)" n/2 • P i W WO • *)> (41) 

where I = 0, 1, 2, ... , —l<m<l, < n < I. 

These families of solutions satisfy the following orthogonality relations: 

with respect to the bilinear pairing 

W 2 > = ^/ (dei^)(y)^ 2 (y)-^. (42) 

2vr^ J ye// ||y || 

t4/so ; i/iese two families of solutions are related by involutions <p(Y) 1— > iV^Y) -1 • (p(Y/N(Y)) 
and^Y)^^.^- 1 ). 

Proof. The functions f|40[) are homogeneous of degree n — 1 and the functions 041 p are homoge- 
neous of degree — (n + 1); if n = 0, then deg/, n 00 = 0. To prove the orthogonality relations 
for /^..(yj's, we integrate in coordinates (|38p using orthogonality identities (|63p . (|69p and 
reduce to the following calculation: 

f 

j — ( 



(cosh p) 1 • p/™^ (tanh p) ■ (cosh p) 1 • p/ n ^ (tanh p) • cosh 2 p dp 

dx (l + n)\ 



f 00 P/ n) (tanhp) • p/ n,) (tanhp) dp = C P/ n) (x) • P/ n °(x) - 
J-00 J-i 1 



x 2 — n)\ 



■ K,n> (43) 



(unless n = n' = 0). 

The last statement follows immediately from (|72p and (|77p . □ 



Remark 69 When n = 0, fl^0[ ) and f^i[ ) yzeZd £/ie same functions. We call these functions 
fi m n(X) the limits of the discrete series in ML Note that p/ n) and p/ n) are proportional 
according to ( 1 6' b}) . and so only n > appear. 
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4.4 Space and s[(4, C)-action 

Let P^j denote the linear span of the functions (|40p and (|4ip . In this subsection we characterize 
the space as a subspace of harmonic polynomials on M, show that it is preserved by the 
sl(4, C)-action and identify this representation with the minimal representation of SO(3,3) ~ 
SL(2,H K )/{±1}. 

First we identify the linear span of the basis (|40p . Then the linear span of the basis (|4ip is 
obtained by applying an involution <p{Y) i-> N(Y)~ 1 ■ p(Y/N(Y)) or ip(Y) \-t fcyy • fO^^ 1 )- 
Recall that r = \J (x 1 ) 2 + (x 2 ) 2 + (x 3 ) 2 and consider algebraic functions p G C[t 
satisfying C^i^ = 0. We denote by C[t, X ^ X ^ X , r }- the subalgebra of polynomials in 
C[t ■ X ■ X - X , r ] spanned by monomials of non-positive degree of homogeneity. 

Proposition 70 The linear span of the basis fa40\ ) can be characterized as 

{^^•CM^^V" 2 ]-"; □3,1^ = 0}. (44) 

Proof. From the definition of the associate Legendre functions f)65|) , (139p and Lemma [99] we see 
that the basis functions (|40p indeed lie in r _1 • C[t : X J X ■ X ■ IT ]— . Also, if we fix I and m, 
there are exactly I + 1 such basis functions which are distinguished by their homogeneity degrees 
d, -I - 1 < d< -1. 

Since the polynomials r l ■ Y l m (6,pys form a basis of polynomial functions on the sphere 
S 2 lying in the linear span of x 1 ,^ 2 ,^ 3 , every function in C[t, x , x 2 , x 3 , r _1 ] can be uniquely 
expressed as a finite linear combination of the monomials 

t°r 6 lf (0,<p), a,l = 0,1,2,... , b G Z, -l<m<l. 

From (I60p and (j62j) we obtain 

□3,1 {t a r b Yr(9, <p)) = (6(6 + 1) - 1(1 + l))tV 6 - 2 yr(^ V) " a(a - 1)^^(6, <p). 

Note that the coefficient of £ a r fc - 2 ^«i - g zeTO ■£ an ^ on iy if 6 = / or 6 = — / — 1, and the co- 
efficient of i a - 2 r b yj m i s zero if and only if a = or a = 1. This implies that we can find 
a function 5 6 C[t,r ±1 ] such that C\s,l(g ■ ^/ m ) = by starting with a monomial i a r^YJ m 
(or ^r^^Y™) and inductively finding the coefficients of £ a - 2 r '+2y^ t^^r^Y™,... (or 
t a ~ 2 r~' +1 Y™, t a_4 r~ /+3 Y" / m ,...) until we zig-zag to t°r*yj m or iMY™. We can summarize 
this observation as follows: 

Lemma 71 Every function in the space {(p G C[t ■ X - X j X . T *]; CI3 iy = 0} is a finite linear 
combination of functions of the type g ■ Y l m (9,(p), where g G C[t, r^ 1 ] is such that d^i(g ■ 
Y l m (9, p)) = 0. Moreover, for a fixed Yf 71 and d G Z, 

'2 i/d>Z, 
1 if -I - 1 < d < I - 1, 
ifd<-l-l. 

This proves that functions (|40p span all of 044 p . □ 

Proposition 72 The Lie algebra sl(4, C) = sl(2,Hc) C g[(2, He) acts on V^, i.e. it pre- 
serves the space of finite linear combinations of functions from MO]) and fl-^ip . Moreover, is 
generated by f£ 0>0 (Y) = fo fifi (Y) = r _1 . 



dim{, G C[t,r*]; 9 "^^2)^7 "} = < 
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Proof. It is sufficient to find the actions of ^ G $1(2, He), B G He, since together with 

their conjugates by ^ G GL(2,Hc) they generate all of s[(2, He). Thus we need to find 

the actions of ^ on the functions r" 1 • (r 2 - t 2 )±™/ 2 . p/ n) (t/r) • ^ m (6>, 99). First 

we consider Jj, then from (|70p and (|7ip we have: 

= r" 1 • (r 2 - t 2 )^ 2 • (r^ 1 • (p/">)'(t/r) T ^if B) (t/r)) • ¥>) 

= r -i • (r 2 - t 2 )(— )/ 2 • P^\t/r) • ^ • ( ( ' + n)[l ~ n + 1} 1 1 • 

1—1 if — n . 

Hence 



qI' fLn(Y) * V(l + n)(l-n + l).f+ mtn ^(Y), (45) 
W^) * -V(l + n + l)(l-n)-f^ n+1 (Y). (46) 

Next we consider -J~. It is sufficient to show that acts on the bases (|39p . By (|77p 

Y™(0,tp) is proportional to P ; (cos#) • e~ im(p . Since gj^r commute with Jj, it is enough to 
show that 

(( r 2 _ t 2y . r -l-l . pH (cos 0) . e ~im^ and A (^ (r 2 _ t3)-i-l . r l . p(m) (cog 0) . e -im V 

are finite linear combinations of elements from (I39p . Using x 3 /r = cos#, (I73p and (1 74 p . we get: 
9 



dx 3 v 



[{r 2 -t 2 ) l -r- l - 1 -P^\cose)-e- im ^) 
= (2/(r 2 - t 2 ) 1 ' 1 • r- 1 -(1 + l)(r 2 - t 2 ) 1 ■ r~ l ~ 2 ) • cos 9 • p/ m) (cos 9) 
+ (r 2 - t 2 ) 1 ■ r~ l ~ 2 ■ ({I + m)P^} (cos 6) - icosfl- P/ m) (cos#)) 
= (I + m){r 2 - t 2 ) 1 ■ r' l ~ 2 • p/^cos 9) 
+ r -' . (^-(r 2 - t 2 ) 1 - 1 - (r 2 - t 2 ) 1 • r" 2 ) • ((I - m + ljlfjj (cos 0) + (Z + m)P™ (cos 9)) 

= 2J l^(r 2 -t 2 ) l - 1 -r- l -PtH^0) 

+ l -^rr( 2lr ^ r2 ~ ^ ~ (2/ + 1)(r2 - • r '^ 2 • 

^(^)^^P^ 
Similarly, we compute 



(Z-m + l)(/-m + 2) 5 / 2 .2W+1 -1-2 p (m-l) 



2(21 + !)(/ + !) dt 2 



r 2 - t^-r-^-P^- 1 ' (cos 9) -e 



-i(m—l)(p 



2/q + m)(|+m + l) (r2 _ t2)W ^ P (_ T D (cos0) . e -*(^-i) V 
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and 



A _ i_!L) ( (r 2 - t 2 ) 1 . r- 1 - 1 . P.( m > 

dx 1 dx 2 I 



(r 1 - t 2 Y ■ r"'" 1 • t; (cos0) • e- im v) 

(r 2 - t 2 ) 1 - 1 - r-'-P^ (cos 9) -e 



21 ( r 2 - t 2 ) 1 " 1 ■ r~ l ■ Ph +1) '™«^ ■ ^ m+1 ^ 
21 + l v '-' 

^ ^ 2 ( (J* +2\l+l „-l-2 n{m+l) 



(r* _ ?y+i . r -i-* . p^>( cos 9) ■ e 



-i(m+l)ip 



(21 + + 1) dt 2 

The derivatives of (r 2 — i 2 ) - ' -1 -r l -P^ 1 (cos 9)-e~ imip are computed in the same way. Finally, 



it follows from these expressions for the action of s[(2, He) that / o o generates all of Pj^. 
□ 

Theorem 73 As a representation o/s[(4, C) ; T>^ is the minimal representation in 
the notations of \Kob0 L In particular, it is irreducible. 



Proof. Consider a function 



<po{X) = (Jl + iV(X)) 2 + 4x12X21 J lel 8 . (47) 

It is easy to see that <p$ is a real analytic function on Hr satisfying □2,29 9 o = 0. In fact, (fo is 
the rescaled generating function /q from [Kob0 , Part III, equation (5.4.1) for p = q = 3. Hence 
it generates the minimal representation (zu^2%,'H) of SO(3, 3) ~ SL(2, Hr)/{±1}. Note that 
— iV^y — l) 2 is a negative real number only when Fle^y) = and 

(-N(e 3 Y _ 1)2) 1/2 = _ { si gn 3 (y) . N ( h Y - 1). (48) 

Using (|37p we obtain: 

(7r{ , ( 7 )¥H))(y) = 2isign 3 (y) • (-4(y 22 - m ) 2 - 16y 12 y 21 ) ~ 1/2 = sign 3 (y) • 

which is proportional to sign 3 (y) • f^Q^Y). As far as representations of Lie algebras are 
concerned, we can drop the factor sign 3 (y). By the previous proposition, this function generates 
the whole span, and the result follows. □ 

The -ff-types of the minimal representation (vj^^,T-L) of sl(4, C) with respect to K = 
SO (3) x 50(3) were identified in |Kob0| . Part I, as 

i = 0,1,2,... , 

i 

where V\ denotes the irreducible representation of SO(3) of dimension I + 1. 

Proposition 74 The basis functions ( |^0[ ) and ( |^1[ ) are the K-finite vectors of the minimal 
representation PL of $1(4, C) with respect to K = SO(3) x 50(3). 
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Define a nondegenerate symmetric bilinear pairing on the linear span of (|40p and (|4ip by 
declaring 

+ + rn ^ 

\fl,m,fSy)i fl',-m',n'(Y)) min = (f l,m,n(Y), J i',-m',n'(^'))miri = ( _ ^^Tri^ 1 ' 1 ' ' ^ m ' m ' ' ^ n ' n ' ' 

{/ltm,n(^)!/|tm',n'(^)}min = (^,m,n(^)' fl',m',n' C^))mm = ^" 

In the second line we exclude ra' = because /jl" / (Y) = fj/ m iQ{Y). By Theorem 168} this 
pairing partially agrees with the bilinear form (|42|) up to a sign. 
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Proposition 75 This bilinear pairing on is g[(2,Hc) -invariant: 

(rf{Z)vi^2) min + <^i,vr r (Z)^ 2 > mm = 0, VZ G [(2,M C ). 
Proof. It is sufficient to show invariance of ( , ) m in under sl(2, C) embedded into g[(2,EIc) as in 
©' (i n) S GL(2,Hc), (_ _] G gl(2, He) and scalar matrices. The invariance with respect 



to the scalar matrices and f J is clear, and the invariance with respect to ( ) follows 



from (I45ll-(l46l). 

To show the s[(2, C)-invariance, we observe that the action of sl(2, C) commutes with deg. 
Hence, for each fixed n, s[(2,C) preserves the linear spans of {fj^ mn (Y)} an d {IFm 
I = n, n + l,n + 2, . . . , —l<m<l. Then the sl(2, C)-invariance follows from Theorem 1681 for 
n > 0, and the case n = has to be considered separately. Heuristically, the action of sl(2, C) on 
the linear span of {ff m q(Y)} i s obtained from the action on {/, n (^)}, w fixed, by setting the 
value of the parameter n = 0. Since this action is described by algebraic formulas and preserves 
( j )min for all n > 0, it preserves ( , ) m in f° r n = as well. □ 

4.5 Extension of H(E&) 

Let I? denote the unitary representation of SX(2,IHIr) in the Hilbert space generated by the 
function (fo(X) defined by (I47p . This is the minimal representation {vj^%, / H) of 50(3,3) — 
SL(2,U R )/{±1} in the notations of |Kob0| . 



Lemma 76 The function 



(N(X) + 1) • N{X - i) 



MX) = — f 7 jj^, X G 



[1 + N(X)) 2 + Ax 12 x 21 

also generates the minimal representation D°. 
Proof. Using (|37p and (I48p we obtain: 



{tfiimW) = sign 3 (y) • = -sign 3 (y) 



-4(^22 - yn) 2 - I62/122/21 



3/2 b ^ ' 2r 2 ' 



which is proportional to sign 3 (y) • / 101 (F). It follows from Proposition [72] that (pQ generates 
the same representation as (fo does. □ 

Proposition 77 The intersection T>° n%(Hjt) is precisely the continuous series component of 
W(H+). 

Proof. Clearly, ^(AT) S ^O^jr)- Then Lemma 1751 implies that ipo cannot have a discrete series 
component and T>° n 7i(H[jt) is contained in the continuous series component of %(lHfj). To 
prove the other inclusion, it is sufficient to show that 

(Ai{X),(p (X)) 1 ^0 and (4oPO,<£oPQ)i ^° for all / = — ^ + iA with A G M x . 
In coordinates (115|) the restrictions of </?o and <^o to SU(1, 1) become 

2cosh-J and <p Q ((p, r, ?/>) = — (e % — + e "*— ) • [cosh. -j . 
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Substituting v = sinh 5 and using a special case of an integral formula 7.512(10) from |GR| 



/ (l + x)- r 2 F 1 (a,b;l;-x)dx 
Jo 



r(a + r-l)r(6 + r-l) 



T(r)T(a + b + r - 1) 
valid when Re(a + r — 1) > 0, Re(6 + r — 1) > 0, we obtain 

0/ _j_ i /*oo / ,_ v _2 

(t\ 1 (X),tpo{X)). = ±- / sinhr - (cosh-) • <#{ x (cosh r) dr 

2_2 1 m Jq V 2/ 22 

= — / sinh-- 2^1 U + 3/2,-/ + 1/2; 1;- sinh 2 -) dr 

« i 2 V 2/ 

2/ -h 1 z* 00 ^ 

= j— / + • 2 F 1 (l + 3/2,-1 + l/2;l;-v)dv 

4* Jo 



21 + 1 r(/ + i)r(-/)_ 21 + 1 21 + 1 

~ 4i~ ' r(l/2)r(3/2) ~ 2isin(vr/) ~ ~ 2i cosh (Trim/) ^ 
In the other case we need to deal with convergence issues, so we observe that 

-2s 



*P 00 (cos1it) = lim *p 00 (coshr) • I cosh 

s— s-o+ V 2 

as a distribution in ImZ. Substituting v = sinh 2 5 we obtain 

(4 P0,<A)(X)) = lim — / sinhr- (cosh-) " • $, (coshr) dr 

— S— !>0+ 4 Jq \ Z/ 

21 + 1 f°° T / r \ -2s / t n 

lim / sinh —•( cosh — ) • 2-^1 (/ + 1, 1; — sinh 2 — ) <ir 



s ^o+ 2 J 2 V 2/ " " J V 2 

2/4 

= lim 

s^o+ 2 



2/ -h 1 f°° l 

lim — / (1 + v)-i~ s ■ 2 Fi(l + 1, -/; 1; -v) dv 

Jo 



21 + 1 r(/ + s + i/2)r(s-/-i/2) 



2 (r(s + l/2)) 2 

= 21 + 1 . r(/ + i/2)r(-/ - 1/2) = 1 = 1 ^ Q 

2 (r(l/2)) 2 cos("7r/) isinh(7rlm/) 

□ 

Remark 78 We can summarize the observation made at the beginning of Subsection \4-^ Theo- 
rem\73\and Proposition\77\ as follows: The Cayley transform switches the discrete and continuous 
series components of the spaces of harmonic functions on Hr and M. 

The Schwartz space r^(H^) "almost" contains the representations T>°, T>~ and P + , meaning 
that %(Hjt) is missing the limits of the discrete series and the functions on Hr corresponding to 
the limits of the discrete series on M (see Remark I69|) . From the point of view of representation 
theory it is natural to add these missing functions to Then the resulting space is just 

a direct sum of three irreducible representations of SX(2,HI]r). Expansions of -^jy^-w) con t a i n 
these missing functions, which is another reason for extending We define an extended 

space 

where T>^ denote the Hilbert space completions of T>^ with respect to an su(2, 2)-invariant inner 
product (which is unique up to scaling). Similarly we can define 

H(M+) = e7r?( 7 )(P+) (sign 3 (y) • (7r?(7)¥>)(y); V G (49) 
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Next we define a nondegenerate gl(2, IHc)-invariant symmetric bilinear pairing ( , )^ H+ ^ on 
%(H+). We declare 



(W,v-) mi) = (v°,v+) mi) = (v-,v-) m) = (v+,v+) nH) = 0. 

Then we extend the pairing ( , )x>- X £>+ described in Proposition [40] by continuity to T>~ © Z>+. 
Finally, we define the pairing on D° by 

(MX),MX)) m + } = <sign 3 (y) • (^(7)^)(Y),sign 3 (y) • (vr?( 7 )^)(Y)> mm , 

where ( , ) m in is the pairing described in Proposition 1751 and extended by continuity to the last 
summand of (|49p . 

For example, in this light the matrix coefficient expansions given in Proposition 05] mean 
that — N ^z-W) 1S ^ e reproducing kernel for T>~ and T> + when, respectively, W G T~ and T + . 
In other words, for each W G T~, the function N ^-W) ^ es * n ^ e ex t en ded space and 

^ {Z) " M z) ' N{z l -w) )u { K) 

is the projection of tp onto its holomorphic discrete series component. Similarly, for each W £ T + , 
the function N ^-w) e "^(^r) anc ^ 



N(Z-W)/ H(M+) 

is the projection of ip onto its antiholomorphic discrete series component. 
4.6 Expansion of 



N(Z-W) 

Lemma 79 Let Z,W G M + , write Z = ie + x x ei + x 2 e 2 + x 3 e 3 , W = te + x 1 ei +x 2 e 2 + x 3 e 3; 
i/ten we /iat> e i/ie following expansions: 



^ ), (50) 



m=—l 



n=~l y ' 



^ (l + n)\ (f 2 -i 2 W 2 ^ ^ ^ W^-^Uf + 2rf J' 

n=— I K ' 

(For the last expansion we assume (2tt + r 2 — t 2 + f 2 — i 2 )/2rr lies in the domain of Q[.) 
Proof. Since cos# = x 3 /r, cos# = x 3 /f and 



1-1 2-2 
X X X X 



sin sin 9 cos(<p — <2) = sin 9 cos </? sin 9 cos </3 + sin 9 sin sin 9 sin y3 = — • — H • — , 

' ' ' ry ry ry y 

from ([77]), ||7S) and ([66]) we get ([50]). 
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Applying (|T8]) with s G C such that e ls = J r ~ 2 Jfc , coss = (e ls + e ls )/2, cos 9 = t/r and 
cos 9 = t/r we get: 

E fe^T • [~ 2 - W 2 • P / n) ('A ) • ^/ n) (* AO = Pl (cos cos 9 + sin sin cos 

n=—l 



r f 2 V r 2 y f 2 \ 1/ f 2 - f 2 V r 2 - i 2 

, tt |r 2 - t 2 | + If 2 - Pk /tt r 2 -t 2 + f 2 -P 



rf 2rf / V rf 2rf 

which proves (|5ip . 

Using (|79p instead of (|78p we prove the last expansion (|52p . Strictly speaking, (|79p applies 

I 2 +2 

only if w ~ 2 Ift = e* s with sGR, but both sides depend on s analytically. □ 

Proposition 80 Let W G M + and Z G {M+ + ae ; a G R, a 7^ 0} C H c . Write Z = 
te"o + x x ei + x 2 e2 + x 3 e3 mt/i t £ C, W = te*o + x 1 ei + x 2 e2 + x 3 e3, t/ien we have the following 
expansions: 

~ 2/ + l/ ' . (r 2 -t 2 )™/ 2 



x QW(t/ r ) • Y~ m {0, <p) ■ Pr>(t/r) ■ YT(9, (p) 



n(z -wy 



provided that i > Ret. Similarly, if Z = te"o + x 1 e± + x 2 e2 + x 3 es G M + and W = te~o + x ei + 
x 2 e 2 + x 3 e 3 G {M + + ae ; a G R, a / 0} with t G C, t/ien 

^2Z + l/ ^ , 1 , m ,. . _ r, n (Z-n)! (r 2 -t 2 )™/ 2 
i=0 \m,n=— t 



1 



JV(Z- W)' 



provided that t > Ret. 

Proof. Letting to = Ret, a = Imt and using (15111 . (152]) . (157]) . the first sum reduces to 



tt r 2 - t 2 + f 2 - t 2 \ . tu' / tt r 2 - t 2 + f 2 - t 2 



Qz — + ^ - si S na • -7T P l — + 



rf 2rf J 2 Vrf 2rf 



q (tt + r 2 -t 2 + r 2 -t 2 \ 
\rf 2rf /' 
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.it r 2 -t 2 + f 2 -t 2 \ t - t 
Im — H -— = a 



provided that 

Tm I 

,rr 2rf / rf 

has the same sign as a. Using 

N(Z -W) = 2tt + r 2 - t 2 + r 2 - t 2 - 2{x l x l + x 2 x 2 + x 3 x 3 ), 

(jSnj) and jSUJ) we see that 

E x 21 + 1^ /x l x l + x 2 x 2 + x 3 x 3 \ / tt ^ r 2 — t 2 + f 2 — t 2 + e 2 \ 1 
2rf V rf ) \rr 2rf ) N(Z — W) 

The other expansion is proved by switching the variables Z and W. □ 

Let Z,W € M+ and write Z = te + x 1 e± + x 2 e 2 + x 3 e 3 , = te + x 1 ei + x 2 e 2 + x 3 e 3 . Then 

1 1 



N(Z -W±iee ) N(Z — W) + e 2 =F 2ie(t — t) ' 
Letting e — > + , from the above expansions and (i76|) we obtain 



7T? 



^2l + l( ' (/-n)! (r 2 -t 2 )"/ 2 (w) 



1 1 



lim I - 



e ^o+ \iV(^ - W) + e 2 - 2ie\t - t\ N(Z - W) + e 2 + 2ze |t - t| 
As distributions on the hyperboloids {N{Z) = const}, the limits 

1 • , 1 

lim — — =- are equivalent to 



e ^o+ N(Z- W)+e 2 ±2ie\t-t\ ' N(Z - W) ± iO 

Thus we can formally write 



i 



(53) 



iV(Z-W)-iO iV(Z-VF) + iO' 
4.7 The Discrete Series Projector on M 

Using expansions of jv(z-vy)±iO obtained in previous subsection, we obtain projectors onto the 
discrete series component on M. Recall that the space of harmonic functions T~L(M. + ) was defined 
in dMJ). Let H R = {Y e M; N(Y) = R 2 }, R > 0, and define an operator on H{M+) by 

(S3? V ) m = ii- i /. - f vTvz^m; - ■ ^) 



£ ^o+ 2vr 2 i VyeHfl V Ar ( y - ^0 + * e N{Y-W)-ie) ; ||F 

1 f ( de^(Y) dei^(y) >\ , 2 



lim — tt \ — — — — — — — — — — — — — cosh p sin 9 dpdOdip, (54) 

£ ^o+ 2n 2 i J Y eH R \N(Y -W)+ie N(Y — W) — is; 



W E 
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Theorem 81 The operator annihilates the continuous series component ofH(M + ) and acts 
on the discrete series component ofT~L(M. + ) by sending 

W » -(Km,n(W)+R^.f^ mn (W)), 

and annihilates /j m oOO- 

Remark 82 We can "localize" the difference of the integrals at the set where N(Y — W) = 0. 
Thus the operator fa54\ ) depends only on the values of deg(p(Y), where Y ranges over a two- 
dimensional hyperboloid ( or cone ifW £ Hr) 

{Y £ M; N(Y) = R 2 , N(Y - W) = 0}. 



Proof. The discrete series on M + is spanned by (|40p and (l41j) . Hence it is enough to check the 
statement for the functions <p(Y) = r" 1 • (r 2 -t 2 ) ±n l 2 ■ P/ n) (t/r) • Y{ n {9, <p), where I = 1,2,3,... , 
— I < m < 1 < n < I. First we expand using (|80p and fj50|) : 

— 21 + 1 ^ / tt r 2 — t 2 + f 2 — t 2 , is \ „ fx l x l + x 2 x 2 + x 3 x 3 
=o 

00 m , 1 .7 9 .9 , ~9 79 • / I 



1 a + i / tt + - r + - r ± ^ 

iV(y — W) ± ie ^— ^ 2rf \rf 2rf 2rf) V rf 



«=0 V m=-Z 

We have deg(p(Y) = ±nip(Y). By the orthogonality relation (|63p . after we integrate out <p and 
8 we are left with integrating over p 

27rn / ' (tt r 2 - t 2 + f 2 - t 2 ie\ „ ( tt r 2 - t 2 + f 2 - i 2 ie 
±-5^ [Ql — + ^ + — -Qi — + 



x (r 2 - i 2 ) ±n / 2 • P/ n) (t/r) • 

Ase-> + , by (J7BJ) we get 



^rr 2rr 

Then using (166p . (15 1 1) and our earlier calculation (143p we can integrate over p to get 

^2vr 2 i • r- 1 ■ R ±n • P{ n \t/f) ■ 1^(0, • (iT"(f 2 - P) n / 2 + R n (r 2 - P)- n ' 2 ). 

Finally, the fact that the continuous series on M gets annihilated follows from Corollary [64] 
or, alternatively, since our expansion fj53|) contains the discrete series only. □ 

We can rewrite the expression Nl y-w)+i0 ~ N(Y-W)-iO g eome t r icaily as follows. 

Lemma 83 Fix W £ M + and let Y range over the hyperboloid Hr. Fix a number £ £ C \ R 
and let W' = (1 + e^)W £ Mq, e > 0, then N(Y — W') is never zero for all e sufficiently small. 

Proof. Let A = Ti{YW + ), then 

N{Y - W) = N(Y) + (1 + ei) 2 N{W) - (1 + ef ) A 
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Write £ = a + ib, a,b £R, then the imaginary part of iV(y — W') is zero if and only if 

26(e 2 a + e)iV(iy) - sbA = A = 2(ea + 1)N(W). 

Then the real part of N(Y - W) is 

N{Y) + (1 + lea + e 2 (a 2 - b 2 ))N(W) - 2(1 + ea) 2 iV(iy) = R 2 - (1 + 2ea + e 2 |£| 2 )iV(iy) ^ 
for all e < 1. □ 

When 7V(y - W") = 0, iV(y - W) = (JV(W) - N(Y)) + e 2 £ 2 iV(VF). Choose G C 

with Im(£i) > and Im(£2) < 0, then 

lixr, .si g n(N(W)-R 2 ). f ( — * - - - ^ * — V degip(Y) dS 



e^o+ & v v ' ; y Ye ^V Ar ( y -^) + ^ iv(y-wo-«e/ ' ||r|| 

nm / I — 7 7~ \ — r 7 j— : — r J ■ deg</?(y) 



^o+y ye ^ R VA r (^-(i+^i)^) iv(y-(i+ £ e 2 )^); ii^ii ' 

We finish this subsection with an analogue of Theorem [81] for left-regular functions. Of 
course, similar result holds for right-regular functions. For convergence reasons we need to 
exclude the functions with components containing fj^oiY). Thus we define S(M + ) to be 
the space of S-valued left-regular functions on M + with both components orthogonal to all 
flmo(yy s w ith respect to ( , ) m i n . Let pjj lscr ( M ) anc [ p<^scr(M) ^ e ^ e projections onto the 
discrete series components of S(M + ) quasi-regular at and oo respectively. 

Theorem 84 Let f G §(M+) a left-regular function and W G M + 7 then 

/pdiscr(M) ^ _ pdiscr(M) (yy^ 

_ v J_ f ( (y-w)+ (y - wy \ 

£ ™+2vr 2 J y ^h r \(N(Y -W) + ie) 2 (N(Y - W) - is) 2 ) y J[ >' 

Proof. Suppose that / : M + — > S is left-regular and homogeneous of degree n — 2 (i.e. (deg + 
1)/ = nf) with ii/O. Let <p(Y) = Yf(Y) : M + — > § be an §-valued function, then degip = nip, 
each coordinate component of (p is a harmonic function and "restricting" (jlip to M we obtain 



VmV? = (^ + V^ + V M y)/ = 2(deg + 1)/ = 2nf + 0. (55) 

For concreteness, let us assume that n > 0. (If / is quasi-regular at infinity, the signs get 
reversed when we apply Theorem ED) Then 

ip(W) + R 2n ■ N(W)~ l ■ <p(W/N{W)) 



e ^o+ 2^ 2 yyg^ VA r (y-w / ) + ie Jv(y-wo-iey ||y|| 

= ^ 2^ jL. Uy-'wo+fe - N ( Y-w)-i) ■ °y ■ ^ + DC" Moo 

Differentiating with respect to W we get 



V u {y(W) + i? 2n • iV(VF)" 1 • (p(W/N(W))) 



if ( (y - w) + (y - vf)+ 

2^ y y65fl V(iv(y_ W ) + ^) 2 - (iv(y-w)-^ 1 • Dy • VMV?(y) ' 
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Finally, by (l55|) . 



•(Vm^) T77T77T ) -2t777J7T-v(t77TJ7t) " 2 T77T77^ ' ( de S ( 



jV(VF) 2 v "^ViV(PF)/ iV(PF) r ViV(PT)/ Af(W) 2 v to ^ViV(VF). 

= (Vmv 3 - 2/ - 2d^g/) (W/N(W)) = 0. 

□ 



5 Separation of the Series and the Plancherel Measure of SU (1,1) 

5.1 Convergence and Equivariant Properties of Poisson Integrals 

In this section we regularize the Poisson and Cauchy-Fueter integrals by replacing N(X — W) 
in the denominator with N{X — W) ± ie and letting e — > + . First we prove that the resulting 
limits converge. Recall that H R = {X G M R ; N(X) = R 2 } C Ujj, where R > 0. 

Proposition 85 Fix an R > and a positive integer n, then, for any Schwartz function tp on 
H R and any W G toitfi JV(W) / i? 2 , tfie limit 

£->o+ 7xen fl (iV(X - VF) + ie) ||X|| 

determines a real-analytic function of W . When n = 1, □2,2V' = 0- Similar statements hold for 
e — > 0~ as well. 

Remark 86 The function tp itself need not satisfy □2,2V' = 0- The limits as e — > + and 
e — > 0~ can yield different functions. We will see later that the difference between these two 
limits corresponds to the continuous series component ofip. 

Proof. This proposition would be trivial if supptp D {X £ H R ; N(X — W) = 0} = 0. On the 

other hand, we will rewrite the integral so that the only "problematic" points are the critical 

points of N{X — W) restricted to H R (as a function of X). It is easy to see that the only such 

critical points are X^ rit = ± , = W, and N(X~~ it — W) 7^ 0. Then we apply a partition of 

\J N(W) 

unity argument to break up the function ip into ipQ + ip c so that ipQ is supported away from 
{X £ H R ; N(X — W) = 0} and ip c is supported away from Xf Tit . 

Let 77 : K — > R be a smooth compactly supported function such that rj(t) = 1 for t near 
and rj(t) = for t near N(Xf rit - W). Then the composition function rj(N(X - W)) is one m 
a neighborhood of {X £ H R ; N(X — W) = 0} and zero in a neighborhood of X^ rit . Define 

MX) = (1 - r){N(X - W))) ■ iP(X), MX) = v{N(X - W)) ■ ^j(X), 

so that ip = ipo + ip c , and set 

/ fw\ f ^o(^) dS f MX) dS 

JxeH R {N(X -W) + ie) \\X\\ Jx&h r [N(X — W) + ie) \\X\\ 

Clearly, the limit 



MW) = Urn, Me(W) 



MX) dS 



^o+ ru ' tv ' J x&Hr N{X-WY \\x\ 
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is a well defined real- analytic function of W. 

Next we analyze tp ce (W). Consider the case n = 1 first and observe that 

exp(it(N(X -W) + ie))dt, 



N(X -W) + ie 



and the integral converges absolutely since the real part of the exponent is — et < 0. Thus we 
can rewrite i/> C)£ (W) as 



! [°° ( [ exp{it(N(X -W) + ie))- ^ C (X) ^] dt, 

JO \Jx&H R 



where we are allowed to switch the order of integration because exp (it(N(X- W) + ie)) \ < 1 

dS 

\\X\\ 



and the function ip c is absolutely integrable on Hr with respect to the measure t^tt. Then the 



limit 

MW) = lim i; c . e (W) = -i f°°( f ex V (itN(X - Wj) ■ M*) ^] dt 
e ^ 0+ Jo \JxeH R 

is a well defined real-analytic function of W. (The integral converges by a standard integration 
by parts argument; this is where the property X crit ^ supple is used.) 
If n > 1, then we can apply the same argument with 

^ /*oo /*oo 

j— — — — - — - w = (-i) n ... exp(i(t 1 + --- + t n )(N(X -W) + ie))dh...dt n . 
(N(X -W) + is) J Jo 

Differentiating under the integral sign we see that □2,2V' = when n = 1. □ 

Lemma 87 The limits 

lim [ dS and lim [ ™ (57) 

^ JxeH R N(X -W)+ie \\X\\ md «» J XeIlR N(X -W)-is \\X\\ (5?) 

determine continuous functions of W on (even if N(W) = R 2 ). 

Proof. Note that when N(W) = R 2 , i.e. W £ Hr, the above argument fails because X - t = ±W 
and N(X^ rit — W) = 0. However, if we remove a small neighborhood V of W in Hr, the above 
argument still shows that the limits 

Hm f MX) dS 

e ™+ JxeH R \v N(X -W)±ie\\X\\ 

converge. On the other hand, as explained in |GS] . the limits 

lim f « X » " S 



e^o+ Jxcv N(X -W)±ie \\X\\ 

converge as well (which is not hard to see directly). Thus we conclude that for R > 0, W £ Hr 
and a Schwartz function ip on Hr the limits (|57p converge. □ 

Recall that deg is the degree operator plus identity: deg = 1 + zJi=o ■ c *5as»" ^ or eacn -R > 0, 
we define operators 1^ and 1^ from H(M.^) into functions on 



(deg x ip)(X) dS 



e^o+ 2vr 2 J x&Hr N{X -W) + ie \\X\\ ' 
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The functions (I R (p)(W) are real-analytic and harmonic for N(W) 7^ R 2 , continuous when 
N(W) = R 2 . By analogy with Theorem 34 in |FL1| and similar results of this article, such as 
Theorems W7\ and I5U| we call these integrals "regularized Poisson integrals". However, this name 
is somewhat misleading since these integrals do not always reproduce functions from %(Hjt). 
We finish this subsection by proving that these regularized Poisson integrals are equivariant 
with respect to the g(i?/j)-action. 

Proposition 88 The operators 1^ and 1^ are equivariant with respect to the -action of 
q(Hr), where q(Hr) ~ so(3, 2) is the Lie algebra introduced in Corollary[ 



Proof. The operators 1^ are equivariant with respect to the nf action of SU(1, 1) x SU(1, 1). 
Thus it is sufficient to show that 1^ are equivariant with respect to the one-dimensional algebra 

q(Hr)' introduced in the proof of Proposition |27] Let g = exp ( ^1 ^ j € G(Hr) 1 . We 

\R t (J J 

want to compare (T^(p)(W) with (I^(p)(W), where dp = TT^(g)(p and (I R (f) = (g) (I R ((p)). For 
t — > and modulo terms of order t 2 , we have 025 p . (|26p and (j27|) . Using Lemma [30| we get 

2n 2 ■ (I^)(W) = lim [ — * — • de^ ( ^ dS 



£ ^o+ Jx&H R N(X -W)±ie A \Ni-R- 1 sinhtX + cosht) J \\X\\ 

l + AtReX/R)-(deg x <p)(X) dS 
£ To+JxeH R N(X-W)±ie Jx\\ 



lim 

On the other hand, using Lemma 10 from |FLlj and Lemma 

1 f (fegx<P)(X) dS 



2n 2 • (I±<p)(W) = £ hm iV( _^ lsinh 1 ^ + cosht) • J 



0+ N{-R- 1 smhtW + cosht) JxeH R N(X -W)±ie \\X\\ 

r (1 + AtReX/R) • (deg x <p)(X) dS 

£ ™+ J XeHR N{X -W)± ie(l - 2tReX/R)(l - 2tReW/R) Jx\\ 

{l + 4±ReX/R)-(deg x (p)(X) dS 



lim 



e ^o+ J XeHR N(X -W)±ie \\X\\ ' 

This proves that the maps I R are g(ff^)-equivariant. □ 

5.2 Regularized Integrals and the Discrete Series Component on H K 

In this subsection we study the effect of the operators I R and on the discrete series component 
of %(Hjt). We prove an analogue of Poisson formula for the discrete series. 

Theorem 89 The operators 1^ and coincide on the discrete series component ofTL(M^). 
Moreover, 

j±. N{Z) -u-K t i ^^J-W^-U^) ifN(W)<R 2 ; 



"n m 




-R-W).tiJW) ifN(W)>R 2 ; 
R 2(2l+\) . N (w)-2i-i . t l n jW) if N(W) < R 2 ; 
t l nm (W) lfN(W)>R 2 . 



( Compare with Theorem ) 

Proof. The proof is based on two lemmas. 
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e 2 



Lemma 90 Let ip be a discrete series matrix coefficient 

t l u _(Z), N(Zr^-t\ L (Z), t l _^(Z), N(Z)-^.t l _ lzl {Z), I = -1-1-2. 

Then, for any R' > 0, R' 7^ R, the functions on Hri 

(Iftip)\ H f , (I Ii ip)\ H i and (p\ H ^ are proportional. 

Proof. The maps ip ^ (I^<p)\ H are (SU(1, 1) x SU(1, l))-equivariant. Let k^ 

R' \ Q g 2 

then by (jl6[) we have 

t l nm (k v -Z-k^) = e~^ +m ^ ■ t l n J.Z), N(k v ■Z-k i> ) = N(Z). 

Let 

be the standard generators of sl(2,C). From (|14p and the Lie algebra action formulas given in 
the proof of Theorem [39] we see that 

o(E 0\_„ofE 0\ „ (0 0\_„ (0 0\ t\ x {Z) and 

\-2Z-l A 



711 {0 o)=^{o oj' 711 {0 f)=^{o f) aimihllate N(Z)-^.UZ); 

fF 0\ fF 0\ Q f0 0\ /0 0\ ..... t-i-i(Z) and 

oJ^'U oj' * l \0 e)=^\o e) anmMate N(Z)~ 2 ^~ 1 ■ t l _!_i(Z). 

At a generic point g € SU(1, 1), vector fields 

oh 711 [0 Hh ni [0 oh * l [0 F 



span the entire complexified tangent space T^SU (1,1) at g. Since (Ir<p)\ h / with ip = t l u (Z) 
or N(Z)~ 2l ~ 1 ■ t l u (Z) are analytic, it follows from the (SU(1, 1) x SU(1, l))-equivariance that 
(F^(f)\ H are proportional to . Similarly, (I^ip)\ H are proportional to ip\ H when 

V = t'_,^Z) or JV(Z)- 2 '- 1 • t'_,_,(Z). □ 

Le mm a 9! « *Z) h ^ = („)« „ ^(Z) = «„« « ^ = (J J) h 

diagonal with A > 0. T/ien 

The proof is done by direct computation, and we postpone it until next subsection. Together 
Lemmas [90] and HQ] imply that the theorem holds for functions 

t\ L (Z), *L,_,(Z), N(Z)- 21 - 1 • t\ L (Z), N(Z)- 21 - 1 • t l _ l= i(Z) 

for / < —1. Then the theorem follows from the (SU(1, 1) x SU(1, l))-equi variance of 1^. 
□ 
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5.3 Proof of Lemma I9T1 

In this subsection we give a proof of Lemma I9T1 

Proof. We use integral formulas 2.117 and 2.662 from [GR| 



x n (a + 6x) j^—J (n — k)a k x r 

dx y, b k ~ x 6 n_1 j bx — a ^ 



x n (a — bx) d (n — k)a k x T 

nr/ , 2m , f2m\ e ax e ax A / 2m \ a cos(2/cx) + 2/c sin(2fcx) 

e ax (cosx) 2m dx = h^5 r> , 1 775 — +C, 

y ' \m J 2 2m a 2 2m - 1 ^\m-k a 2 + 4k 2 



'2m + l\ a cos(2£; + l)x + (2k + 1) sin(2A; + l)x 
m 

We parameterize Hr as in (|15p so that 



e^Ccos x) 2m+1 dx = - V I I 1 Z ; Z 1 1 ; ^Hf^ Z ^ x , ^ 

1 J 2 2m ^\m-k) a 2 + ( 2 /c + l)2 



(cosll ~ • 2 sinli ~ * 2 \ 1 

. . r ii=2 , t ' < r < 00, 

smh 2- e 2 cosh 2 -e 2 y -27r<^<2^. 

Then p£r = ^- sinh r dipdrdip and 

iV(X - W) = i? 2 + A 2 - 2i?A cosh ^ • cos £±Z. 

Changing variables 6> = E±^, 0' = x = cosh § and letting a[e) = R 2 + A 2 + ie, 6(0) 

2RXcos6, we obtain 



2/ + 1 f 27T f°° f 2n R 2l+2 ■ (cosh S ) 2 ' • e ±«(^) . s i n hT 

"167^2" £ 5? ± y^ y r=0 y, =0 — ivw^yr^ — d ^ r# 

2/ + i r 2 ^ /■«> /*r R 2l + 2 ■ (cosh ^a+i. e ±<a«. sinh r 

lim / / / —77; 775 777 7 7—7 d6 drdO 



47T 2 e-s>o± 76) = o 7t=o ./0'=o -R 2 + A 2 — 2i?A cos 6 ■ cosh ~ + ie 
7T £ ->o± Je=-K/2 Jx=i \a[e) ~ b(6)x a(e) + b(9)xj 

-7T/2 



lim / • : : 2/+2 log v — + lp g ^ ^ " 



-^ 2 (i-(-i)=« + fc). b(e) fc-i - 
^ (21 + k + l)a(s) k I 



dO. 



21 + 1 (7? 2 + A 2 ) a+1 W 2 e ±i2;e / / a(e) -b(g) \ / q(e) + 6(g) \\ 

- 4n 2 2i A 2i+2 }™ ± y 0= _ V2 (cos^) 2 '+ 2 'V V J + g V 6(0) J J 

From now on we assume 21 is odd; the other case is similar. Integrating by parts we get 

(jitMrno-fi^ )(w)- 2l + 1 {R2 + x2)2l+1 vV " 2Z " 2 ^ J ^' fc ) 

i„)(W/) - (7 fl - ^ 7-277-2 ^ y-/ - — ij 4 / 2 -(2fc + l) 2 ' 
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where integrals 1(1, k) can be computed using residues: 



1(1, k)= I e ±i2W ((2k+l)s\n(2k+l)e±i2lcos(2k+l)6)-(\og( [ - 

Je=-n/2 V V 



t/2 

f7r/ 2 



6 2 (0) 



_ 9( R 2 , A 2X2 f ^ -W2W _ fl (2fc+l) S in(2fc+ 1)0 ±^008(2^ + 1)0 

— 2(1? + A / e • tan _ ^ — d9 



1 0=^,2 (R? + X 2 ) 2 - AR 2 X 2 cos 2 9 

;an0- ^ 

i(R 2 + A 2 ) 2 jf s 2 - 1 (2k + l)(s 2i + s ~ 2/ )(s 2fc+1 - s" 2 ^ 1 ) - 2/(s 2 ' - s - 2l )(s 2k+1 + s^ 1 ) ds 



,r>2 n2a2 r „ (2fc + l)cos(2Z0)-sin(2A; + l)0-2Zsin(2J0)-cos(2A; + l)0 
(R+X)l tan0 (l? 2 + A 2 ) 2 -41? 2 A 2 cos 2 ^ 



= — 7T 



4 Js 2 + 1 (i? 2 + A 2 ) 2 -i? 2 A 2 (s + s- 1 ) 2 s 

From the factorization 

It^A 2 

s 2 

and decomposition 



(i? 2 + A 2 ) 2 - R 2 X 2 (s + s" 1 ) 2 = —(s - R/X)(s + R/X)(s - X/R)(s + X/R) 



(R 2 + A 2 ) 2 • (s 2 - 1) _ i? 2 A 2 



( J R 2 + A 2 ) 2 -i? 2 A 2 (s + s~ 1 ) 2 1? 2 -AV A 2 -l? 2 s 2 1 + s 2 
we see that the residues are 

l((2fc + 1 - 2/)((A/ J R) 2Z+2fe+1 - (i?/A) 2Z+2fe+1 ) 

+ (2/ + 2fc + 1) ((X/R) 2k+1 - 21 - (R/Xf k+1 - 21 )) • ( +1 at ±VjR ' 

' 1—1 at ±R/X 

and 

z(2fc + 1 - 2l)((X/R) 2l+2k+1 + (R/X) 2l+2k+l - 2 ■ i 2l + 2k +^) 

- i(2l + 2k + l) ((X/R) 21 - 21 "- 1 + (R/Xf- 21 *- 1 - 2 • i 2 '- 2 ^- 1 ) at 0. 

\X/R if A < J?, 
Letting r = < we get: 

[R/X itX>R, 

{iit\ l )(w) = (i±t i _ l=1 )(w) = 



(R 2 + X 2 ) 2l+1 ^ 2 / -2/ -2 \ (r- 2l - 2k - x - i- 2 *" 2 *- 1 r -2/+2fc+i _ i -2Z+2fe+i\ 
" 2(2/ + 1) A 2 ^ 2 " ^ W-fc-§J V -2/ - 2fc - 1 + -2/ + 2fe + l J 

= -2(2/ + 1) • {R2 +£f +1 e (_7_ s) £ (*- 2l - 2k - 2 + -~ 2 ' +2fc ) d * 



( jR 2 + A 2 ) 2m ,r 



J 2(21 + l)x(l + x 2 ) 



-21-2 



\2l+2 

(R 2 + A 2 ) 2/+1 . 2 ._2i-i _ / i? 2(2m) • A- 2 (' +1 ) if A < .R; 
A 2 *+ 2 ' ( +rj "{A 2 ' if A > 12. 

□ 
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5.4 Regularized Integrals and the Continuous Series Component on EI 



In this subsection we determine the actions of the operators 1^ on the continuous series compo- 



nent of H(W^). Combining this with Theorem 1891 we get a complete description of the actions 
of on %(Hjjj). We state the main result of this section: 

Theorem 92 The operator 1^ — 1^ annihilates the discrete series component of Its 
action on the continuous series component ofH(W™) is given by 



((/+ - r R )t l nm ){w) = (i + i? 4Im ' • N(w)~ 2l ~ l ) ■ t l n jw) 



{coth(7r Im I) if m,n G Z; 
tanh(7rImZ) ifm,n G Z + ^. 



where Re I = — | and W G 



The proof of this theorem will be given in the next subsection. 

Remark 93 Strictly speaking, the matrix coefficient functions of the continuous series repre- 
sentations t l nm (X), I = — 1/2 + iX with A6l, do not belong to %(Hjt). So the theorem should 
be restated as follows: If 

<P(X) = ( tnt iX (X)- V (X)dX, 

where 77(A) is a smooth compactly supported function onI\ {0}, then ((!# — I^)(f)(W) is 

f XeR coth(vrA) • (1 + R 4X ■ N (W)~ 2X ) ■ t~^ iX (W) ■ 77(A) dX ifm,n€ Z; 
J AeR tanln>A) • (l + R iX ■ N(W)- 2X ) ■ t~t~ tX (W) ■ 77(A) dX z/m,nGZ + ±. 

Note that the expression 

JcothgmO ifm>n€Z; 

is precisely the inverse of the Plancherel measure of SU(1, 1)! Since degi^ m = 2ImZ • t l nm , we 
can reformulate Theorem 1921 as follows: 

Theorem 94 The operator 

dS 



annihilates the discrete series component ofH(W^). If Re I = and W G Hj^, 



\X\ 



( coth(-7r Im V) • ,. _ -n 

I =5 — = — - ij m, n G Z; 



(piflO(wo = (1 + ^ • aw 2 '- 1 ) • 4 TO (w) • ; ' " ' ! 

I Tml ^/m,nGZ+i. 



Remark 95 ^4s in the Minkowski case (see Remark \8ty) , for each W G integrals ((1^ — 
Ift)(p)(W) and (PlR(p)(W) depend only on the values of (degip)(X), where X ranges over a 
two-dimensional hyperboloid (or cone ifWE Hr) 

{X G Hr; N(X) = R 2 , N(X -W) = 0}. 
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We can rewrite the expression N(X-W)+iO — N(X—W)—iO g eome trically as follows. Let us 
consider W' = (1 + e£)W G H c , e > 0, £ E C \ R. Then, for X G 5C/(1, 1), W G H+, 

AT(X - W') = N(W) -N(X- W- 1 - (1 + e£)) ^ 

for all e < 1 because X ■ W' 1 G A^T-Tp 1 / 2 • SU(1, 1) cannot have an eigenvalue 1 + e£. When 
N{X - W) = 0, iV(X - W') = ei(N(W) - N{X)) + e 2 £ 2 iV(W0. Choose G C with 

Im(^i) > and Im(£ 2 ) < 0, then 

hm sign(iV W - 1) • / _ L, y _* , - ^ y _L_, g Vw 



£ ^o+ bV v ; 7 /x e stf(i,i) ~ Wj+ie iV(X - W) - is) ^ y ' \\X\\ 

^o+y X6S[/(ljl) Viv(x-(i+ £ a)w) iv(x-(i+ee2)w)y v '11*11 

Proposition 96 T/ie operator + Ir annihilates the continuous series component ofH(M.^). 

Proof. Let 99 be in the continuous series component of %(ELt). Since (Ir + 1^)^ is analytic, it 

. 

is enough to show that deg ((Ir + Ir)^) vanishes on Hr for k = 0, 1, 2, . . . . By Theorem 1501 
(Sp o ._ 1 99) (TV) and (S^ ff <£>)(W) vanish identically for W in the open set 

«(V :) r+ - v -> l 

For G -ff_R we have: 

" Um (S~ ^ + S+^)(W0 

1 /■ ( (de^)pf) (ggy)(X) \ . 

k 

Hence (1^ + I^)ip vanishes on Hr along with all derivatives deg ({Ir + , k = 0,1,2, ... . 

□ 

This proposition combined with Theorems [89] and [92] gives us a complete description of the 
actions of and 1^ on the discrete and continuous series components of ~H(M^). 

We conclude this subsection with a result for left-regular functions. (Of course, similar result 
holds for right-regular functions.) 

Theorem 97 The operator sending left-regular functions f(X) G S(Hi) into 
annihilates the discrete series component. //Re / = — \, 



(l + m + \)t l nm _±(X) J ^ I (l + m+ \)t l nm _x{W)) '\tanh(7rlm0 z/m^G/' 1 



coth(7r Im I) if m,n G Z; 

^ I- 



This theorem follows from Theorem [92] in exactly the same way Theorem [84] follows from 
Theorem 1811 in the Minkowski case. 
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5.5 Proof of Theorem 

In this subsection we give a proof of Theorem [ 
Proof. The operators 1^ are equivariant with respect to the subgroup SU(1, 1) x SU(1, 1) of 
5L(2,Hc). Also, by Theorem l89l the operators 1^ coincide on the discrete series component of 
7i(fiR). Therefore, the operator Ir—Ir annihilates the discrete series and sends the continuous 
series component into itself. To determine the action of 1^ — 1^ on the continuous series 
component we use a couple of reductions. First, it is sufficient to prove the theorem for R = 1 
only. Indeed, substituting X' = R' 1 ■ X G SU(1, 1) and W = R' 1 ■ W we get 

(r± f l )(W) _ f feO^') dS _ 2l (±l v ! 

Secondly, we can reduce the proof of the theorem to the case N(W) = 1: 
Proposition 98 When N(W) = 1, and Rel = -\ 

I coth(-/r Im I) if m,n G Z; 



((/ 1 + -/r)4rn)W = <mW 



1tanh(7rlm/) if m, nGZ+^. 



We postpone the proof of this proposition until the end of this subsection. By Lemma 10 in 
|FL1| and direct computation we have: 



1 



^N(X -W)±ieJ ~ N(X' - Y) ± f ■ iV(e 3 X' - 1) • 7V(e 3 Y - 1) ' 
where X' = nfa-^X) and Y = ^-^(W). When N(X) = N(W) = 1, 

N(e 3 X' - 1) • iV(e 3 y - 1) = Tr(e 3 X') • Tr(e 3 y) = -4Re(e 3 X') • Re(e 3 y). 
Therefore, by Theorem 1601 



S ign3(y).vr0( 7 )((/+-/ 1 -)^)(y) 



£ ^o+ 2vr 2 7 x , ei? ViV(X' -y) + ie iV(X' - Y) - is) v MUU/r ' M ' ||X'|| 

= -Sf(7r?( 7 )^)(y). (58) 

Then by Theorem I8T1 and Lemma [6"T1 we have deg((/^ — /{" -)<p) (W) = whenever W G 517(1, 1). 
Now Theorem [92] follows from Proposition [98] and the uniqueness part of the theorem given on 
page 343 in jSt]. That theorem essentially states that the Cauchy problem for □2,2V 3 = with 
boundary data on 5^7(1, 1) in the continuous series component of L 2 (SU(l,l)) has a unique 
analytic solution. (Caution: there can be other non-analytic solutions.) □ 

The rest of this subsection will be devoted to the proof of Proposition [98] 
Proof. We start with (j58p and track down carefully which functions in the continuous part 
of H(U+) get sent where in H(M+). The operator <p ^ (7+ - I{)cp is 517(1,1) x 517(1,1)- 
equivariant. This means that if tp is a continuous series function, then (7^ — Ii)<p\su(l 1) * s 
proportional to (p with a coefficient of proportionality possibly depending on I and whether m, 
n are integers or half-integers. We essentially compare the expansions of degy (^(7)^) (Y) and 
sign 3 (y) • (^(7)^) (y) in terms of basis functions (|40p or (|4ip . In order to find this coefficient 

' l,m,n 

those expansions. 



of proportionality we pick a basis function /, and find the ratio between the coefficients in 
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Let Y 



yu y^) £HcM + and w 

2/21 2/22, 



Wll W12 

W21 W22 



7r,(7)(^)€ 5^(1,1). By (133, 



2/22 - yu 



2 + yn + y 2 2 tyu 
-2?/2l 2 - yn - y 2 2 



From ffTHI) 
Since 



, 3 t 4 - (yn + y 22 ) 2 1 + t 2 
cosh — = £11X22 = ~~ 



1 



(y22-yn) 2 (x 3 ) 2 cos 2 0' 
2 + yu + 2/22 1 - it 1 - i sinh p 



coshr 



cos 2 8 



X22 2 — (2/11+2/22) 1 + 1 + isinhp' 
(which is ambiguous), and 



e 2 = ±-( 



1 + i sinh p 
1 — i sinh p 



■ -01 —-02 Xl2 

e 2 



2i 2/12 



tan# 



sinh ■ 



-up 



sinh ^ y 2 2 - yu sinh • 



isign(cos6*) • e 1<P , 



we obtain 



t^) = (isign(cos^)) m 



COS z I 



1 • ± 



1 + i sinh /? 



. J(n-m)<p 



1 — i sinh /? 

To avoid the sign ambiguity we simply set m + n = 0. Then, by Lemma [61 

2 



>2m 



/ n , / x , , sign(cos 0))' 

si g n 3 (y) • K( 7 )tL m J(y) = ,_//„, • <pi 



cosh p • I cos 1 



cos^ 



1 -e 



deg y (7r?( 7 )tL wim )(y) = (2/ + 

— cosh p ■ cos z (/ 



(i sign (cos 9)) 2m 



cos 



2 # 



-2imtp 



1 -e 



-2imy 



On the other hand, when N(Y) = 1, the functions f\ ul ,(Y) are proportional to 



r- 1 • P^ } (i/r) • P^ J (cosfl) • = (coshp)" 1 • Pf ; (tanhp) • P^ ; (cosfl) • e 

Thus fjL = 2m and we need to compare integrals 



Mi 



Mi 



i flip 



(sign(cos0)) 2m -<pi_ 



cos 2 



1) -pf m) (cos0) • |tan0|de 



y P^tanhp)^ 



and 



(2Z+1)( / (sign(cos#)) 2m -^ 



- mm Vcos 2 l 



l)-pf m) (cos0) 



tan 6 



cos 1 



d0 



pj^tanhp) 
cosh p 



dp 



Substituting u = tanh p, we find 



p[ u) (tanhp)dp 



1 P ( x\u) 
, 1-u 2 



pj^tanhp) 
cosh/? 



dp 



1 ff(u) 

1 vT^? 
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If we take v = A, p{ (u) is proportional to (1 — u 2 ) A//2 , and 
Thus, 

IZ^^dp (r(A/2 + l/2)) ; 



l^oo Pl A) (tanhp) dp r(A/2) • T(A/2 + 1) 
It remains to compare the integrals over 9. When m < 0, by (|19| 



**— kg? - = r(l + m +")"(-% "I *-»!-»■■ ^ («-n+l, - t- ^; -iim+li - tan° «). 

If m is a half-integer, we need pi 2 ™- 1 (x) to be odd, so we can take A = 1 — 2m; then p| 2m ) (cos 0) 
is proportional to cos 9 ■ sin~ 2m 9. Substituting v = tan 2 9 and using a special case of an integral 
formula 7.512(10) from [GR] 



roo 

j x c_1 (l + x)~ r 2-^1 (a, &; c; — x) dx 

^0 



r(c)r(a + r - c)r(6 + r - c) 



r(r)r(a + 6 + r-c) 
valid when Re c > 0, Re(a + r — c) > 0, Re(6 + r — c) > 0, we obtain 

r(l + m + l)(-2m)l /"" 2 , J 2 y 
V(l-m+l) Jo *~ mm \cos 2 9 J 

roo 

= / v~ 2m ■ (1 + v ) m - 3/2 ■ 2 Fi (Z - m + 1, -I - m; -2m + 1; -«) du 

_ r(l - 2m)r(3/2 + /)r(l/2 - Z) _ vr (2/ + l)r(l - 2m) 
(r(3/2-m)) 2 ~ 2cos(ttZ) (r(3/2-m)) 2 ' 



r(Z-m + l) y ^ mm Vcos 2 / 



/•oo 

/ ?T 2m • (1 + u) m_1 • 2F1 (J - m + 1, -I - m; -2m + 1; -v) dv 
Jo 

r(l - 2m)r(l + l)T(-l) tt T(l-2m) 



(r(l-m)) 2 sin(vrZ) -m)) 2 



• (59) 



Hence the ratio of the coefficients of f^_^ in the expansions of degy (^f(^)t l _ mrn )(Y) and 
sign 3 (y)-(7rf(7)tL mM )(y)i S 

(r(3/2-m)) 2 (r(A/2 + l/2)) 2 
( } ' (r(l-m)) 2 ' r(A/2)-r(A/2 + l) = Atanh (vrImZ). 

If m is an integer, we need P^ m \x) to be even, so we can take A = —2m; then P^ m \cos9) 
is proportional to sin -2 " 1 9. As was already computed in (|59|) . 

^(Z + m+^m)! y' 2 ^ J_2_ _ ^ . sin - 2 . , . tan , ^ = rO^m) 



r(Z-m + l) J ^- mm \cos 2 9 J sin(^)(r(l-m)) : 
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In the other case we need to deal with convergence issues, so we observe that 



cos 2 6 J r46+ ^" mm Vcos 2 ' 



as a distribution in ImZ. Then substituting v = tan 2 0, 

2 r (i + r'* L j2 _ x cos2r _ t s . n _ 2m 

r(Z-m + l) 7o Vcos 2 / 

• (1 + t,)™" 1 ^ . 2j p x _ m + 1; _/ _ m . _ 2m + !;-«) cfo 



oo 



r(l-2m)r(l/2 + Z + r)r(-l/2-i + r) asr ~>o+ -2vr r(l - 2m 



(r(l/2 -m + r)) 2 cos(ttZ) (2Z + 1) (r(l/2 - m)) 2 

as a distribution in ImL Hence the ratio of the coefficients of f^_x \ hi t ne expansions of 
degy (irf('j)tL (Y) • (7r?(7)tL mm )(F) is 

(r(l-m)) 2 (r(A/2 + l/2)) 2 

— 2ztan (ttl) ■ ■ —j- . . — —7- , — - — - = Acotn(7rlmt . 

1 ; (r(l/2-m)) 2 r(A/2) • T(A/2 + 1) v 1 

□ 

6 Appendix: Review of Special Functions 

In this appendix we review special functions used in this paper: the spherical harmonics 
Y™{9,(p), the associated Legendre functions P^ m \x), the associated Legendre functions of the 
second kind (x) and some of their identities. References: |Er] . |GR] . |Vil] . 

6.1 Spherical Harmonics 

Let M 3 be the three-dimensional space with coordinates ( X <j X j X ). We denote the Laplacian 

by 

- 92 , ° 2 , 92 

3 " (dx 1 ) 2 + {dx 2 ) 2 + (dx 3 ) 2 ' 

We use the spherical coordinates 



x 1 = r sin 6 cos (p r > 

x 2 = r sin sin ip < 99 < 2ir 
x 3 = r cos < 9 < ir. 



1 d ( 2 df\ , 1 9 f^n d f\ , 1 92 / 



In these coordinates 

3 ^ r 2 9r ^ ' 9r J r 2 sin6> 90 ^ 90 J r 2 sin 2 # di/? 2 ^ ^ 

Let denote the matrix coefficients of SU(2): 



X = f Xn Xl2 ^l G 5*7(2) Z = °' 2 ' 1 ' ^' 2 '' ' ' ' 

lx 2 i £22/ m,n = -1,-1 + I, . . . ,1, 
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where the integral is taken over a loop in C going once around the origin in the counterclockwise 
direction (see [VilJ). We define the spherical harmonics on M 3 by setting 

Yr(e,<p) = t l m0 (g), 1 = 0,1,2,..., m = -1,-1 + 1,..., I, 

where 



cos | • e 2 z sm | • e 2 \ _ / e 2 W cos | 1 sm § \ / e 2 



mnf-e^ cosf-e-^y \0 e^JKi^i cos § J [ e"4 



(61) 



with < (f < 2tt, < 9 < tt, —2ir < ip < 2ir. Using induction on I, relation between the 
spherical harmonics and the associate Legendre functions (|77p and recursive relation ([73 p . one 
can prove: 

Lemma 99 The functions r l • Y l m (6, if) are polynomial in x , x 2 , x 3 of degree I. 
The functions Y l m (6,ip) , s satisfy 

A 3 Yr(0,<p) = -■^ L • YT(9,<p) (62) 

and form a complete orthogonal basis of functions on the unit sphere S 2 . They also satisfy an 
orthogonality relation 



Yr(e,^) ■ y { r m (e,<p) ■ sine d<pde = (-i) m -— . s l>v ■ 6 m>m >, (63) 

J<p=0 M + I 



which follows from (i77|) . f)68|) and (166p using substitution x = cos 6. From (I60p and (162p we 
obtain two classes of solutions of the harmonic equation A3/ = 0: 

r l -Y^iB,^) and r~ l ~ x ■ Y t m (e, y), Z = 0,1,2,..., -l<m<l. (64) 
6.2 Legendre Functions 

The associated Legendre functions (x) and the associated Legendre functions of the second 
kind Q^{x) are two linearly independent solutions of the second order differential equation 

(l-x 2 M-2x^+(l{l + l)--^)f = 0. 



dx 2 dx V 1 — x 2 

While the parameters I and m can be arbitrary complex numbers, we will only be interested in 
I = 0, 1, 2, . . . , m € Z, —l<m<l. The associated Legendre functions (of the first kind) are 
functions defined by the formula 

P m) (x) = 1 „ (1 - x 2 )™/ 2 -^— (1 - x 2 ) 1 . (65) 



If we set m = we get Legendre polynomials: 

-] 

~¥l\ dx 1 



P /( x)=P/ 0) (x) = y^^(l-x 2 y, x G C. 



Then, for m > 0, 

p' m )(x) = (-i) m (i-x 2 r /2 ^flw. 



66 



Functions P^ and P,' are related as follows: 

p/-™)(x) = (-ir^^}.P^(x). (66) 

When m is even, P^ m ) (x) is a polynomial of degree I and denned on the entire complex plane. 
On the other hand, when m is odd, P^ (x) is defined as long as y/l — x 2 is single- valued. There 
are different conventions for choosing the domain of p/ m ^(x), ours is that P/ m) (x) is defined 
on the complex plane away from the two cuts along the real line: along (—00, —1] and [l,oo). 
(But, for example, in |Er| the associated Legendre functions are defined on the complex plane 
with the interval [—1,1] removed from the real line.) 

The associated Legendre functions of the second kind are defined on the complex plane with 
the interval [—1,1] removed from the real line. One way to define these functions is by declaring 

Q (z) = Q$\z) = ^log(^), Qi(z) = Qf\z) = |log(^ 
and then by recursive relations 

(21 + l)z ■ Q\ m \z) = (I - m + 1) • Q\™l(z) + (I + m) ■ <$?\{z\ 
which is formally identical to (|73p . 



d m 

and 



q,w w = - ir /'JL- Ql(z]i m > . 



Finally, we introduce functions Q, (z) defined on the complex plane away from the two 
cuts along the real line: along (—00, —1] and [l,oo) (same domain as for P^ (z)'s). We set 

Q[ m) (x) = !^Q( m )( x + iO) + ^Q{ m) (x-iO), x€ (-1,1) CM. 
From the identity 

Q\ m \x ± iO) = ^ m (g[ m) (x) T y^/ m) (x)) , x G (-1, 1), 
we see that Q^{x) extends analytically to the upper and lower half-planes by 
qH ( z \ _ f* m Q! m) W + f Pt\z) if I"* > 0; 

^ 1 j " \r™g; m) (z)-fp/ m) (,) ifimz<o. 1 ' 

6.3 Identities 

The associated Legendre functions satisfy two kinds of orthogonality relations: 



1 pWu dW/^ ^ _ 2(Z + ro)! 

(2l + l){l-m)\ 



PP(x) ■ P/ mj (x) dx = , o> ,\^ 7 • S k>l , < m < /, (68) 
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and 

if m / n; 



dx 



x 2 



{l+m)\ 
n(l—m 

oo if m = n = 0; 



m (i- m )\ if m = n / 0; < m, n < I. (69) 



There is a recursive relation for the associated Legendre functions: 

| P M W + _^. P M W .__L_. Pri ) (x) . (70) 



Combining it with (166)) we obtain: 

^pt™)/,) mx pW M _ (l + m)(l-m + l) p (m-i) M (? ) 

We will also use the following identities: 

p/ m) (-x) = (-l) l+m . p/ m) (x), (72) 

(2/ + l)x • p/ m) (x) = (Z - m + 1) • P,g (x) + (Z + m) • p£J (x) , (73) 

(1 - x 2 ) • ^-P, M (x) = -lx ■ P/ m) (x) + (Z + m) ■ P^(x), (74) 

g{~ m) (x) = (-l) m |^| • <?["%), x G (-1, 1), (75) 

i m Q[ m) (x + iO) - r m Q{ m) (x - iO) = -7rzP/ m) (x), x G (-1, 1). (76) 
The associated Legendre functions and the spherical harmonics on R 3 are related as follows: 



YT(0, <p) = t l m0 (g) = ■ J Iq-^j • P/ m) (cos0) • e"^, (77) 

where g is as in (|6ip . From the multiplicativity property for the matrix coefficients t^ n 's and 
(177p one can obtain 

E inr%^ • p / m W) • if («* = fl(ooB 7 ), V G C, (78) 

m=—l 

where cos 7 = cos cos #+sin 6 sin # cos (p. There also is a similar formula involving the associated 
Legendre functions of the second kind: 

E TrT^^ • p t m \^s9) ■ Q[ m) (cos0) = QKcos 7 ), <p G M, (79) 
^— ' (Z + ml! 

m=—l 

which follows from (1751) and 



Q,(cos 7 ) = P(cos0) • Q,(cos0) + 2 V m j; p/ m) (cosfl) • Q, (m) (cos0) • cos(m^). 

z — ' (/ + my. 

m=l 

We will also use the following relation: 

00 1 

V(2/ + l)P(x)Q,(y) = , (80) 

the sum converges uniformly when x ranges over compact subsets lying inside the ellipse passing 
through y and foci at the points ±1. 
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